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(54) OPTICAL DISC FOR HIGH RESOLUTION AND THREE-DIMENSIONAL IMAGE RECORDING, 
OPTICAL DISC REPRODUCING DEVICE, AND OPTICAL DISC RECORDING DEVICE 



(57) In an optical disc on which image signals of 
high resolution are recorded and a system for reproduc- 
ing thereof, compatibility with a conventional system for 
reproducing image signals of normal resolution is to be 
realized. Image signals of high resolution are divided 
into a main signal and an auxiliary signal by an image 
separating member, and a first Interleave block (54) and 
a second interleave block (55) formed by dividing each 
MPEG-coded stream into groups of frames of one GOP 
or more are alternately recorded on an optical disc (1). 
In a reproducing device capable of handling high resolu- 
tion, both the first and the second interleave blocks are 
reproduced, thus providing an image of high resolution. 
On the other hand, in a reproducing device incapable of 
handling high resolution, only one of the first and the 
second interleave blocks is reproduced, thus providing 
an image of normal resolution. 
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Description 
TECHNICAL FIELD 

[0001 ] The present invention relates to an optical disk 
having a three-dimensional {3D) picture and a high def- 
inition picture stored thereon, and an apparatus for 
recording data to or reproducing data from the optical 
disk. 

BACKGROUND ART 

[0002] A conventionally known optical disk having a 
3D moving picture stored thereon is as shown in Rgure 
10. An optical disk 201 has a picture for the right eye 
(right-eye picture) stored in even fields 204, 204a and 
204b and a picture for the left eye (left-eye picture) 
stored in odd fields 203. 203a arxj 203b. The right-eye 
picture and the left-eye picture are recorded alternately. 
When the data stored on the optical disk 201 Is repro- 
duced by an existing optical disk reproduction appara- 
tus 205 shown in Rgure 11. a right-eye picture and a 
left-eye picture appear on a TV screen 206 alternately 
every 1/60 second. The naked eye recognizes only a 
picture In which the right-eye picture and tfie left-eye 
picture are overlapped. With 3D spectacles 207, in 
which a shutter for tfie right-eye picture and a shutter for 
the left-eye picture are switched over every 1/60 sec- 
ond, a 3D picture is recognized. As shown in Rgure 12, 
a right-eye picture and a left-eye picture are each 
encoded alternately in every other field as an Interlace 
signal in 1 GOP of an MPEG signal. 
[0003] For high definition pictures, progressive sys- 
tems referred to as 525P and 720P have been studied. 
[0004] A first problem of the conventional art will be 
described. When data In a conventional 3D optical disk 
is reproduced by an ordinary, conventional 2D repro- 
duction apparatus, even a non-3D picture, i.e., even a 
2D picture Is not output. Data In the 3D optical disk is 
only reproduced by a reproduction apparahjs con- 
nected to a 3D display. Accordingly, It is required to cre- 
ate two types of optical disks, i.e., a 3D optical disk and 
a 2D optical disk for the same contents . The same is 
true with the high definition picture. In other words, the 
conventional 3D and high definition optical disks are not 
conpatible with ordinary optical disks. A first objective 
of the present invention is to provide a 3D or high defini- 
tion optical disk which is compatible with ordinary opti- 
cal disks, arxJ a reproduction system for the 3D or high 
definition optical disk. 

[0005] The term "compatibility" is clearly defined as 
similar to the compatibility between monaural records 
and stereo records discussed in the past In other 
words, data in a novel 3D or high resolution disk accord- 
ing to the present invention is output as a "monaural" 
vision, i.e.. as a 2D picture or an ordinary resolution pic- 
ture by an existing reproduction apparatus developed 
for DVDs or the like, arxj is reproduced as a "stereo" 



vision, i.e.. a 3D picture or a high resolution picture by 
the novel reproduction apparatus according to the 
present invention. 

[0006] A second problem of the conventional art con- 
5 cerns a synchronization system. According to a conven- 
tional synchronization system, decoding starts when 
decoding conditions for each conpressed video signal 
are provided. The conventional synchronization system 
has prot)lenrts in that, for example, when the data 
10 becomes out of synchronization for some reason during 
reproduction, compensation is not performed; and that 
audio data is not synchronized. 

[0007] A second objective of the present invention is 
to provide a reproduction apparatus for reproducing a 
15 plurality of compressed video signals or a plurality of 
compressed audio signals in synchronization with one 
another and performing compensation when the data 
becomes out of synchronization during reproduction, 

2o DISCLOSURE OF INVENTION 

[0008] The present invention Includes tiie following 
means to achieve the above<lescribed objectives. 
[0009] An optical disk according to tiie present inven- 
ts tion is obtained in the following manner Two moving pic- 
tures each having a frame rate of 30 frames/sec. are 
input A plurality of frames of each picture, which corre- 
spond to 1 GOP or more of the disk, are set as a picture 
unit These picture units of the two pictures are 
30 arranged on the optical disk alternately as interieave 
blocks. Each interieave k»lock corresponds to one rota- 
tion or more. The two moving pictures can be. for exam- 
ple, a picture for tiie right eye and a picture for tiie left 
eye; or includes field conrponents of a progressive pic- 
as ture. 

[001 0] When such an optical disk Is reproduced by an 
ordinary reproduction apparatus for two-dimensional 
(2D) display, an ordinary two-dimensional is repro- 
duced. 

40 [001 1 ] A reproduction apparatijs for 3D and high def- 
inition pictures according to the present invention 
includes means for reproducing picture identification 
information from an optical disk, means for reproducing 
a two-dimensional picture in a conventional process, 

45 means for reproducing a 3D or high definition picture, 
and means for outputting the 3D or high definition pic- 
ture. 

[0012] The present invention includes the following 
means to achieve the second objective. 

50 [0013] A reproduction apparatus according to the 
present invention includes reference time signal gener- 
ation means for generating a reference time signal; and 
a plurality of picture extension/reproduction means hav- 
ing a function of extending a compression video stream 

55 and controlling reproduction time of the extended video 
signal in accordance with the difference between the 
reference time signal and the picture reproduction time 
information. 
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[0014] Another reproductiOT apparatus according to 
the present invention includes a plurality of picture 
extension/reproduction means having a function of gen- 
erating a reference time signal, extending a conpres- 
sion video stream and controlling reproduction time of 5 
the extended video signal in accordance with the differ- 
errce between the reference time signal and the picture 
r^oductfon time information. The reference time sig- 
nals in the plurality of picture extension/reproduction 
means are corrected using identical information at sut>- 10 
stantially the same time. 

[0015] Still another reproduction apparatus according 
to the present invention includes reference time signal 
generation means for generating a reference time sig- 
nal; and a plurality of audio extension/reproduction is 
means having a function of extending a conpression 
audio stream and controlling reproduction time of tiie 
extended audio signal In accordance with the difference 
between the reference time signal and the audio repro- 
duction time information. 20 
[001 6] Yet another reproduction apparatus according 
to the present invention controls reproduction time by 
changing the frequency of the clock by which the audio 
extension/reproduction means performs extension and 
reproduction. 25 

BRIEF DESCRIPTION OF DRAWINGS 

[0017] 

30 

Rgure 1 is a block diagram showing a recording 
apparatus in one exanple according to the present 
invention. 

Rgure 2 is a timing diagram showing the relation- 35 
ship between an input signal and a recording signal 
in one example according to the present Invention. 

Rgure 3 Is a top view of an optical disk showing tiie 
interleave block arrangement in one example 40 
according to the present invention. 

Rgure 4 is a view illustrating 3D picture arrange- 
ment information one exarrple according to the 
present invention. 45 

Figure 5 is a view showing a reproduction appara- 
tus in one example according to the present irrven- 
tion. 

50 

Rgure 6 is a timing diagram illustrating the relation- 
ship between a recorded signal and a picture output 
signal in a reproduction apparatus in one example 
according to the present invention. 

55 

Rgure 7 is a trfock diagram showing an MPEG 
decoder of a different system of a reproduction 
apparatus in one exanple according to the present 



invention. 

Rgure 8 is a timing diagram shewing the relation- 
ship between a recording signal and an output sig- 
nal when 2D reproduction is performed witii a 
reproduction apparatus In one example according 
to the present invention. 

Rgure 9 is a trfock diagram showing a 2D reproduc- 
tion apparatus in one example according to ttie 
present invention. 

Rgure 10 is a top view showing data arrangement 
of a conventional optical disk having a 3D picture, 

Rgure 11 is a t)Iock diagram showing a reproduc- 
tion apparatus for reproducing a conventional opti- 
cal disk having a 3D picture. 

Rgure 12 is a timing diagram showing the relation- 
ship between a recording signal obtained by repro- 
ducing a conventional optical disk fiaving a 3D 
picture and a picture output signal. 

Rgure 13 is a timing diagram showing the relation- 
ship among a virtual 3D identifier, an R output and 
an L output in one exanple according to the 
present invention. 

Rgure 14 Is a reproduction sequence view showing 
the d'rfference of f pointer accessing in an ordinary 
picture reproduction mode and a 3D reproduction 
mode in one example according to the present 
invention. 

Rgure 15 is a flowchart (I) illustrating how a proc- 
ess of accessing a pointer is changed in accord- 
ance witii whether a 3D video signal is r^roduced 
or not in one example according to the present 
invention. 

Rgure 16 is a flowchart (II) illustrating how a proc- 
ess of accessing a pointer is changed in accord- 
ance witfi whether a 3D video signal is reproduced 
or not in one example according to the present 
invention. 

Rgure 1 7 is a flowchart showing how the manner of 
output Is changed in accordance with whether the 
signal to be reproduced is a 3D video signal or not 
by a 3D reproduction apparatus in one example 
according to the present invention. 

Rgure 18 is a view showing a 3D picture identifier in 
a 3D picture logical anangement table in one exam- 
ple according to the present invention. 

Rgure 19 is a flowchart showing a method for spec- 
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ifying the attribute of each chapter, cell and inter- 
leave block of a 3D picture based on a 3D picture 
identifier in the 3D picture logical arrangement table 
in one example according to the present invention. 

5 

Figure 20 is a block diagram of a reproduction 
apparatus in an interlace picture signal output 
mode In one example according to the present 
invention. 

10 

Rgure 21 is a block diagram of a reproduction 
apparatus in a progressive picture signal output 
mode in one example according to the present 
invention. 

15 

Rgure 22 is a block diagram of a recording appara- 
tus in a progressive picture signal input mode in 
one exanple according to the present invention. 

Figure 23 is a view illustrating the principle of multi- 20 
pie angle video data division multiplex system in 
one example according to the present invention. 

Figure 24 is a block diagram of a reproduction 
apparatus in a 3D picture signal reproduction mode 2S 
In one example according to the present invention. 

Rgure 25 is a block diagram of a 4X reproduction 
apparatus In a 3D progressive picture signal repro- 
duction mode in one example according to the 30 
present Invention. 

Rgure 26 is a block diagram of a reproduction 
apparatus in a multi-stream progressive picture sig- 
nal reproduction mode in one example according to 35 
the present invention. 

Rgure 27 is a view illustrating a data structure of 
the entire optical disk in one example according to 
the present invention. 40 

Rgure 28 is a view illustrating an inner structure of 
a volume information file in Figure 27 in one exam- 
ple according to the present invention. 

45 

Figure 29 is a ftowchart showing a detailed process 
for reproducing a program chain group by a system 
control section M1-9 in one example according to 
the present invention. 

50 

Figure 30 is a block diagram showing a structure of 
a part of an AV synchronization corrtrd 12-10, the 
part performing AV synchronization, in one exam- 
ple according to the present invention. 

55 

Figure 31 is a timing diagram showing a data 
stream which is reproduced and output tiirough a 
buffer of the decoder in one exanple according to 
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tfie present invention. 

Rgure 32 is a view Illustrating a method for reduc- 
ing interlace Interference by turning on or off a filter 
in one example according to the present invention. 

Rgure 33 is a view illustrating the principle of an 
encoding system using a common nrx}tion detecting 
vector in one example according to the present 
invention. 

Rgure 34 is a view illustrating a method for adjust- 
ing the timing for reproducing data from a DVD disk 
in one example according to the present invention. 

Rgure 35 is a timing diagram showing reproduction 
of an irrterleave block when one video stream is 
switched to another in one example according to 
the present invention. 

Rgure 36 is a view illustrating the principle of 
recording two progressive video signals after divid- 
ing them into interleave blocks in one example 
according to the present Invention. 

Rgure 37 is a flowchart showing a method for skip- 
ping a first dummy field of a VOB in one example 
according to the present invention. 

Rgure 38 is a flowchart illustrating a process of 
STC switching for seamless connection in one 
exanple according to the present Invention. 

Rgure 39 is a block diagram of data decoding in 
one example according to the present invention. 

Rgure 40 is a view illustrating the principle of divid- 
ing a scope (wide) picture in a horizontal direction 
and recording the resultant signals as interleave 
blocks in one exanple according to the present 
invention. 

Rgure 41 is a view illustrating the principle of syn- 
tiiesizing a scope (wide) picture from an optical disk 
having the scope picture in a divided State and 
processing tiie synthesized pictijre with 3-2 trans- 
form in one exanple according to the present 
invention. 

Rgure 42 is a structural view of a system stream 
and video data on an optical disk in one exanple 
according to the present invention. 

Rgure 43 is a flowchart for seamless connection in 
one example according to the present invention. 

Rgure 44 is a view illustrating a method for dividing 
interpolation infornration in fiorizontal and vertical 
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directions and recording the resultant signals in 
interleave blocks in one exanple according to the 
present invention. 

Rgure 45 is a timing diagram of reproduction of pro- s 
gressive, 3D and wide signals with respect to the 
data amount in buffer in one example according to 
the preserrt invention. 

Rgure 46 is a structural view of a horizontal filter io 
and a vertical filter in one example according to the 
present invention. 

Rgure 47 is a block diagram of a reproduction 
apparatus which shares a common motion vector is 
signal and color information in one example accord- 
ing to the present invention. 

Rgure 48 is a view illustrating the principle of 
motion detection of a progressive picture using a 20 
motion detection vector in one example according 
to the present invention. 

Rgure 49 shows a signal format of a picture identi- 
fier in one example according to the present inven- 25 
tion. 

Rgure 50 shows contents of a vertical filter and a 
horizontal filter in one example according to the 
present invention. 30 

Figure 51 is a view illustrating the principle of divid- 
ing and recording a 1050 interlace signal in one 
example according to the present invention. 

35 

Rgure 52 is an arrangement view for outputting a 
progressive signal, an NTSC signal and a HDTV 
signal in one example according to the present 
invention. 

40 

Rgure 53 is a view showing a progressive repro- 
duction method for reproducing an interieave block 
while referring to a video presentation time stamp in 
one example according to the present invention. 

45 

Figure 54 is an arrangement view of an HDTV sub 
signal and an NTSC signal by simultaneous casting 
in one exanple according to the preserrt invention. 

Figure 55 is a block diagram of a reproduction so 
apparatus for an HDTV/NTSC disk by simultaneous 
casting in one example according to the present 
invention. 

Figure 56 is a flowchart illustrating a method for ss 
controlling two buffers in one example according to 
the present invention. 



Rgure 57 is a flowchart illustrating a metiiod for 
performing AV synchronization of a first decoder 
and a second decoder in one example according to 
the present invention. 

Rgure 58 is a view illustrating the principle of an 
MADM system for dividing a signal into two in a hor- 
izontal direction in one exarrple according to the 
present invention. 

In Rgure 59, (a) is a view illustrating processing of 
an entirety of a horizontal filter circuit in one exam- 
ple according to the present invention, and (b) is a 
view illustrating processing of each line of the hori- 
zontal filter circuit in one exarrple accordir^ to the 
present invention. 

Rgure 60 is a block diagram of a system for dividing 
a scope-size picture into two in a horizontal direc- 
tion and recording in the MADM system in one 
example according to the present invention. 

Rgure 61 is a view illustrating the principle of a pro- 
vider defined stream multiplex system (vertical divi- 
sion) in one example according to the present 
invention. 

Rgure 62 is a view illustinating the principle of a pro- 
vider defined stream multiplex system (horizontal 
division) in one exanple according to the present 
invention. 

Rgure 63 shows a signal format of provider defined 
stream multiplex system in one exanple according 
to the present invention, 

Rgure 64 is a block structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. 

Rgure 65 is a structural view of a video decoder in 
one exanple according to the present invention, 

Rgure 66 shows a data structure of an optical disk 
in one exarrple according to the present invention. 

Rgure 67 is a timing diagram of video reproduction 
in one example according to the present irtvention. 

Rgure 68 is a block structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. 

Rgure 69 is a structural view of an audio decoder in 
one exanple according to the present invention. 

Rgure 70 shows a data sto-ucture of an optical disk 
in one example according to the present invention. 
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Figure 71 is a timing diagram of audio and video 
reproduction in one example according to the 
present invention. 

Figure 72 shows an optical disk reproduction appa- s 
ratus in one example according to the present 
invention. 

Rgure 73 is a structural view of a video decoder in 
one example according to the present invention. io 

Rgure 74 is a timing diagram of video reproduction 
in one example according to the present irrvention. 

Rgure 75 is a block structural view of an optical disk is 
reproduction apparatus in one exanple according 
to the present invention. 

Rgure 76 is a structural view of a video decoder in 
one example according to the present invention. 20 

Rgure 77 is a structural view of a video decoder in 
one exam^^e according to the present invention. 

Rgure 78 is a structural view of a video decoder in 25 
one example according to the present invention. 

Rgure 79 is a Wock structural view of an optical disk 
reproduction apparatus in one example according 
to the present invention. 30 

Rgure 80 is a structural view of an audio decoder in 
one example according to the present invention. 

Rgure 81 shows a data structure of an optical disk 35 
in one example according to the present invention. 

Rgure 82 is a timing diagram of audio and video 
reproduction in one example according to the 
present invention. 40 

Figure 83 is a timing diagram of operation frequen- 
cies of audio and video reproduction in one exam- 
ple according to the present invention. 

45 

Rgure 84 is a timing diagram of operation frequen- 
cies of audio and video reproduction in one exam- 
ple according to the present invention. 

Rgure 85 is an IP sti-uctural view of an MADM so 
stream in one example according to the present 
invention. 

Rgure 86 shows a method for preventing a conven- 
tional reproduction apparatus from outputting a sub ss 
picture signal in one exanple according to the 
present invention. 



Rgure 87 shows simulation calculation results 
showing a bu^er amount required for simultaneous 
reproduction in one example according to the 
present invention. 

Rgure 88 is an arrangement view of continuous 
t}locks and interleave blocks in one example 
according to the present invention. 

Rgure 89 is an arrangement view of interleave 
blocks in one example according to the present 
invention. 

Rgure 90 is a fcrfock diagram of multiple (2) screen 
in one example according to the present invention. 

Rgure 91 is a view illusta-ating the principle of divid- 
ing a high resolution video signal in a horizontal 
direction to obtain two streams, recording the 
streams, synthesizing the two streams to reproduce 
tiie high resolution video signal (luminance ^gnal) 
in the first example according to the present inven- 
tion. 

Rgure 92 is a view illustrating tiie principle of divid- 
ing a high resolution video signal in a horizontal 
direction to obtain two streams, recording the 
streams, synthesizing the two streams to reproduce 
the high resolution video signal (color signal) in the 
first example according to the present invention. 

Rgure 93 is a flowchart illustrating the compatibility 
when an MADM disk in the first example according 
to the present invention is reproduced by a conven- 
tional reproduction apparatus. 

Rgure 94 is a fbwchart illustrating an operation of 
reproducing an MADM disk in the first exarrple 
according to the present invention by an MADM 
reproduction apparatus. 

In Rgure 95, (a) is a view illustrating an accessing 
process using a pointer of first reproduction infor- 
mation when an MADM disk in the first exanple 
according to the present invention is reproduced by 
a conventional reproduction apparatus, and (b) is a 
view illustrating an accessing process using second 
reproduction information when an MADM disk in 
the first example according to the present invention 
is reproduced by an MADM reproduction appara- 
tus. 

Rgure 96 is a block diagram of a r^roduction 
apparatus for synthesizing two streams in the first 
example according to the present invention. 

Rgure 97 is a t>lock diagram of a system for repro- 
ducing two streams obtained by being divided on a 
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frame-by-frame basis and synthesizing the streams 
in a time axis in the first example according to the 
present invention. 

Figure 98 is a t»lock diagram of a recording appara- 5 
tus and a reproduction apparatus for dividing a pro- 
gressive video signal into two streams and 
synthesizing the signals into the progressive video 
signal in the first example according to the present 
invention. io 

BEST MODE FOR CARRYING OUT THE INVENTION 

[001 8] The best mode of the present invention will be 
described with reference to the figures. is 
[0019] In this specification, a recording and reproduc- 
tion system for simultaneously reproducing a plurality of 
streams according to the present invention will be 
referred to as an "MADM** system. 

[0020] In the first example of the present invention, a 20 
method for recording and reproducing a 3D picture and 
a high d^inrtion picture will be first described, and then 
a method for realizing the high definition picture will be 
described, both as applications of the MADM system 
according to the present invention. In the second 25 
through eighth examples, practical methods for syn- 
chronization used for reproducing data according to the 
MADM system will be described. 

(Example 1) 30 

[0021] . According to the present invention, a 3D pic- 
ture and a wide screen picture are recorded in the stale 
where tiie picture is divided into two pictures of a right- 
eye picture and a left-eye pictijre, or divided into two 35 
screen pictures sqwated from each other along a hor- 
izontal line. These two pictures are field pictures starting 
from an odd line, and a signal representing such a field 
picture is referred to as an Odd First signal. A progres- 
sive picture is recorded as being divided into two screen 40 
pictures separated from each other along a vertical line. 
These two screen pictures are represented by a field 
signal starting from an odd line and a field signal start- 
ing from an even line. These signals are referred to as 
an Odd Rrst signal and an Even Rrst signal. In this 45 
specification, a recording unit of picture information of 1 
GOP or more which has been processed with interleav- 
ing is referred to as an interleave block or a frame group. 
The system according to the present invention is 
referred to as a multiple angle video data division multi- so 
plex (MADM) system. 

[0022] Rgure 1 is a block diagram of an MADM sys- 
tem recording apparatus 2 for an optical disk according 
to the present invention. A progressive signal and a 3D 
signal can both be recorded- A right-eye signal of the 3D ss 
picture is referred to as an R-TV signal, and a left-eye 
signal is referred to as an L-TV signal. The R-TV signal 
and the L-TV signal are conpressed into MPEG signals 



by MPEG encoders 3a and 3b. As a result, an R-MPEG 
signal and an L-MPEG signal as shown in part (2) of 
Rgure 2 are obtained. These signals are processed 
with interleaving by an interleave circuit 4. so tiiat an R- 
frame group 6 including R-frames 5 corresponding to 1 
GOP or more of the R-MPEG signal and an L-frame 
group 8 including L-frames 7 corresponding to 1 GOP or 
more of the L-MPEG signal are alternately arranged as 
shown in part (3) of Rgure 2. The recording unit is 
referred to as an interleave block, and may also be 
referred to as a frame group in this specification. The R- 
frame group 6 and the L-frame group 8 include an iden- 
tical number of frames having an identical time period, 
so that the right-eye signal and the left-eye signal are 
synchronized with each otiier when being reproduced. 
The frame group is also referred to as a picture data 
unit One picture data unit corresponds to 0.4 to 1 sec- 
ond. A rotation speed of a DVD is 1440 rpm. i.e., 24 Hz 
along the innermost track. Accordingly, an interleave 
block corresponds to one or more rotations or further. 
10 to 20 rotations as shown in part (4) of Rgure 2. 
Returning to Rgure 1, address information is output 
from an address circuit 13. Progressive/3D picture 
arrangement information is output from a progres- 
sive/3D picture arranganent information output section 
10. These pieces of information are recorded on the 
optical disk by a recording circuit 9. The progressive/3D 
picture arrangement information includes an identifier 
which indicates whether or not a progressive or 3D pic- 
ture is present on the optical disk, or a progressive/3D 
picture arrangement table 14 shown in Rgure 4. As 
shown in Figure 4. a TEXTDT file 83 includes, for each 
VTS. 3D pictures for the right and left eyes and angle 
numbers and cell numbers in which the progressive sig- 
nal is located. Since a PGC file of each VTS includes a 
starting address and a termination address of each cell, 
the starting address and the termination address of 
each cell are included in the progressive/3D picture 
arrangement information. Based on the arrangement 
information and identification information, the reproduc- 
tion apparatus outputs a progressive picture or a 3D pic- 
ture con^ectly as progressive outputs or R and L outputs. 
When ordinary pictures of different contents from each 
other are output as R and L outputs in error, the user will 
feel uncomfortable since the pictures for the right eye 
and the left eye are not related to each other. The pro- 
gressive/3D picture arrangement information or pro- 
gressive/SD picture identifier have an effect of avoiding 
the output of such unpleasant pictures. The manner of 
using tiie progressive/3D picture arrangement informa- 
tion and progressive/3D picture identifier will be 
described in detail later together with a description of 
the r^roduction apparatus. 

[0023] In the recording apparatus shown in Rgure 1 , 
a 525P or other progressive signal can be recorded with 
multiple angles. Specifically, a progressive signal is 
divided into a sum component and a difference compo- 
nent by a division section 38, thereby creating two inter- 
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lace signals. The two interlace signals are encoded by 
the two MPEG decoders 3a and 3b. In this case, a 
VPTS which is synchronized with an ARTS of an audio 
signal is provided to a first MPEG signal and a second 
MPEG signal by a VPTS provision section 81 , Such pro- $ 
vision will be described in detail later. 
[0024] A specific method for creating 3D picture 
arrangement information will be described. A DVD-fbr- 
mat optical disk has files of a directory or table of con- 
tents stored in a standardized manner in a recording 
starting area th^-eof. However, these files do not 
include any description on 3D pictures. Accordingly, a 
3D picture logical arrangement file 53 including a 
3D/PG lecture logical arrangement tatAe shown in Rg- 
ure 18 is provided, so that a rejxoduction apparatus 
conforming to 3D reproduction reads the file. An ordi- 
nary 2D reproduction apparatus cannot read the 3D/PG 
picture logical arrangement file 53 but provides no prob- 
1^ since such an ordinary 2D reproduction apparatus 
does not r^roduce a 3D picture. 
[0025] Hereinafter, the table in Figure 18 will be 
described. DVD video information includes a three-layer 
logical hierarchy. The three layers are a video title set 
(VTS) layer representing a movie or other worK a part 
of video title (PVT) layer representing a chapter in the 
titie, and a cell (Cell) layer representing a stream in the 
chapter. 

[0026] The arrangement of 3D pictures in each layer 
will t>e described. "000" indicates ttet there is no 3D or 
progressive cell; "110" indicates that all cells are 3D 
cells; and "001" indicates that there are 3D cells and 
non-3D cells. 

[0027] In Rgure 18, regarding the VTS layer, the sta- 
tus of title 1 is "001 "; i.e.. the VTS layer of titie 1 includes 
both 3D and ordinary cells. The status of titie 2 is "1 1 0"; 
i.e.. all the cells in the VTS layer of titie 2 are 3D cells. 
The status of titie 3 is "000"; i.e., there are no 3D cells in 
the VTS layer of titie 3. Accordingly, irrfornration on 3D 
pictures is not necessary regarding the lower layers of 
tities 2 arKi 3. 

[0028] Regarding PVT layer of title 1 . the status of 
chapter 2 is "000"; i.e.. there are no 3D cells in the PVT 
layer of chapter 2. The status of chapter 3 is "1 10"; i.e.. 
all the cells are 3D cells in the PVT layer of chapter 3. 
The status of chapter 1 is "001"; i.e.. there are both 3D 
cells and the ordinary cells in the PVT layer of chapter 
1. Regarding tiie cell layer of chapter 1, cells 1 and 2 
con^espond to R and L data of a first stream. Cells 3 and 
4 correspond to R and L data of a second stream. In 
cells 5 and 6. ordinary pictures are recorded. In the 
embodiment where the 3D/PG picture logical arrange- 
ment file 53 is separately recorded on the c^tical disk in 
this manner, the conventional file is not altered. Accord- 
ingly, conrpatibility between the 3D/PG pictures and the 
ordinary pictures is realized. The logical information 
reveals all the physical information on the optical disk. 
Accordingly, a malfunction of displaying ordinary pic- 
tures of two different contents for the right eye and the 



left eye is prevented. Moreover, the 3D picture can be 
appropriately reproduced and decoded so that R and L 
data are provided to the right eye arKi the left eye from 
the correct output sections. 

[0029] With reference to the flowchart of Figure 19, a 
process for determining whether or not each cell 
includes a 3D or progressive picture based on the 
3D/PG picture logical arrangement table 52 will be 
described. In step 51a, the 3D/PG picture logical 
arrangement table 52 is read from a first recording area 
of the optical disk. In step 51 b, the VTS layer of titie n as 
shown in Rgure 18 is checked. When the status of the 
VTS layer is "000", it is determined that no 3D or pro- 
gressive cell is included and thus 3D processing is not 
performed. When VTS=1 10 in step 51 c, all the cells are 
processed as 3D cells in step 51 d. In step 51 e. odd cells 
are processed as including a left-eye picture arKi even 
cells are processed as including a right-eye picture. In 
step 51 f . a menu screen is caused to indicate that all the 
cells in title n are 3D cells. When VTS=001 in step 51 g. 
tiie arrangement information of chapter n of the lower 
layer is checked in step 51 i. When PVT=000 in step 51 j, 
it is determined that chapter n include no 3D or PG cells 
in step 51k. When PVT==110 in step 51m, it is deter- 
mined that all the cells in chapter n are 3D cells in step 
51 n. Then, the processing goes to step 51 d, where the 
menu screen indicates that the all the cells in chapter n 
are 3D cells. When PVT=001 in step 51 p. each of the 
cells in that chapter is checked. When Cell=000 in step 
51s regarding one cell, it is determined that the cell is 
not a 3D cell and the processing goes back to st^ 51 q. 
When Cell=m-R in step 51 u, it is determined that the 
cell corresponds to R data of stream m in step 51 v. 
When Cell=m-L in step 51 w. it is determined that the 
cell corresponds to L data of stream m in step 51 x. 
Then, the next cell is checked in step 51 q. 
[0030] In the emfc>odiment where the 3D/PG picture 
logical arrangement tat^e 52 is additionally recorded in 
this manner, it is effectively determined whether or not 
each of all the vkJeo titles, chapters and cells includes 
3D data. PG data or neitiier of such data. 
[0031] This will be described with respect to the top 
view of the optical disk in Figure 3. An optical disk 1 has 
one spiral track formed therein. The R-frame group 6 is 
recorded on a plurality of R tracks 11, 11a and lib. In 
actuality, the R-frame group 6 is recorded on 5 to 24 
tracks. The L-frame group 8 is recorded on L tracks 12, 
1 2a and 1 2b, and tiie next R-frame group 6a is recorded 
on R tracks. 11c. lid and lie. 

[0032] Hereinafter, a reproduction operation will be 
described with reference to the block diagram of the 3D 
reproduction apparatus according to the present inven- 
tion in Rgure 5 and the timing diagram in Rgure 6. 
When a signal from the optical disk 1 is reproduced by 
an optical head 15 and an optical signal reproduction 
circuit 24 and a 3D picture identifier is detected by a 3D 
picture arrangement information reproduction section 
26, or when picture data which has been determined to 
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have a 3D picture based on a 3D picture arrangement 
table 14 shown in Rgure 4 is to be reproduced and an 
input section 19 or the like issues an instruction to out- 
put a 3D picture; a switch section 27 is controlled so that 
an R signal and an L signal are output from an R output 5 
section 29 and an L output section 30 and so that the R 
and L signals are output alternately on a field-by-field 
basis from an RL mixture circuit 28. The control of the 
switch section 27 is performed simultaneously with the 
processing of the 3D picture, ro 
[0033] With reference to Rgures 5 and 6, an operation 
for reproducing a 3D picture will be described. As 
described with reference to part (3) of Figure 2, the R- 
frame group 6 and the L-frame group 8 are alternately 
recorded on the optical disk. The R-frame group 6 and is 
the L-frame group 8 each include frames corresponding 
to n QOPs, where n is an integer of one or more. Rgure 
85 represents such a state in detail. Two (right arxl left) 
streams are recorded on the disk alternately. Each 
stream includes intra-frame encoded frame data repre- 20 
sented as I and inter-frame encoded frame data repre- 
sented as B or P. and is divided into interieave units with 
the intra-frame encoded frame as a disconnection point. 
[0034] In Figure 6. part (1) shows the entirety of the 
disk, and part (2) shows a part thereof. An output signal 25 
from an optical signal reproduction drcuit 24 in Rgure 5 
is represented as part (2) of Rgure 6. The signal is 
divided into an R signal and an L signal by a switch sec- 
tion 25. and tiie time axes of the R signal and the L sig- 
nal are matched to an original time axis respectively by so 
a first buffer circuit 23a and a second buffer circuit 23b. 
By this operation, input signals, shown in part (4) of Rg- 
ure 6, to be input to R- and L-MPEG decoders are 
obtained. The signals are respectively processed by 
MPEG decoders 16a and 16b in Rgure 5. Thus. R and 35 
L output signals which are synchronized with each other 
as shown in parts (6) and (7) of Rgure 6 are sent to a 
picture output section 31. An audio signal is extended 
by an audio output section 32 and then output. 
[0035] Since the two {R and L) signals are output 40 
simultaneously in this manner, a flickeriess picture is 
obtained by sending a 60 fjps (frames/sec.) signal from 
each of the R output section 29 and the L output section 
30 to the 3D TV having two (R and L) outputs. In tiie 
embodiment where an RL mixture signal having 60 45 
fields/sec. is sent from the RL mixture circuit 28, a 3D 
picture can be viewed with an ordinary TV and 3D spec- 
tacles, although tiie picture flickers. In the embodiment 
where an RL mixture signal having 120 fields/sec. is 
output, a flickeriess 3D picture can be viewed witfi a 2X so 
scan TV and 3D spectacles. In the case where a 3D pic- 
ture is not being output as a 3D picture, a signal is 
added by a "3D" display signal output section 33 so that 
the TV screen display a symbol irxjicating "30". Th^. 
the user is notified that he/she is viewing 3D software in 55 
a 2D mode and is urged to switch to the 3D output 
mode. In the emlxxliment where a 3D control signal 
generated by a 3D spectacle control signal generation 



section 33a for switching right and left shutters of the 3D 
spectacles is detected from a frame synchronization 
signal for a decoding signal or from the RL mixture cir- 
cuit 28 and output to an external device, a synchroniza- 
tion signal for the 3D spectacles is obtained. 
[0036] When a line memory 28c of an n-screen syn- 
thesis section 28b in Rgure 90 is used, n pieces of pic- 
tures (e.g.. two pictures) are output on a TV screen as 
one NTSC signal picture in wftich the two pictures are 
synthesized. Therefore, two angles can be viewed witii 
an ordinary TV A conventional 1 X reproduction appara- 
tus inconvenientiy displays only one angle at one time 
out of multiple angles. The present invention allows two 
streams to be reproduced simultaneously with a 2X 
reproduction apparatus and tiie MADM reproduction 
system, and also allows two screens to be displayed 
simultaneously. Accordingly, it is rx>t necessary to 
svdtch the multiple angles. 

[0037] As shown in Rgure 90 in detail, when the line 
memory 28c of the n-screen syntheas section 28b is 
used, a two-picture display 28f of two pictures A and B 
having the same size is obtained. Since a line memory 
has a simple structure and is integrated into an IC, tiie 
n-screen picture display is obtained with a sirrple struc- 
ture. When a frame memory 28d is used, a two-picture 
display 28g of two pictures having different sizes is 
obtained by a zoom signal from a zoom signal genera- 
tion section 28e. Since the user can arbitrarily set tfie 
size by remote control, the TV picture can be advanta- 
geously viewed at an optimum size. 
[0038] In the block diagram in Rgure 5. two MPEG 
decoders are used. The structure is sinrplif ied by the cir- 
cuit configuration shown in Rgure 7. The first MPEG 
signal and the secord MPEG signal are synthesized 
into one MPEG signal by a synthesis section 36, and a 
2X clock is generated by a 2X clock generation section 

37. A 2X calculation is performed by a 2X clock-type 
MPEG decoder 16c, and tiie data is extended and out- 
put as R and L video signals through a division section 

38. Such a circuit configuration advantageously limits 
an increase in the cost since it is only necessary to add 
a 16 MB SD-RAM to a memory 39 of an existing 2D 
reproduction apparatus. 

[0039] With reference to Figure 7, synchronous repro- 
duction of two streams which is important in decoding 
3D picture data and progressive picture data will be 
described. Rrst, it is necessary to adjust vertical and 
horizontal synchronization of two streams within a sin- 
gle line. In order to do this, a first MPEG decoder 16a 
and a second MPEG decoder 16b are started substan- 
tially simultaneously by a vertical/horizontal synchroni- 
zation control section 85c to synchronize the decoders 
1 6a and 1 6b. Then, it is necessary that the outputs from 
the two decoders shoukJ be pictures having an identical 
VPTS. This will be described with reference to the flow- 
chart in Rgure 57 and Rgure 7. In step 241a. the syn- 
chronization of a first decoder and a second decoder is 
cancelled. In step 241 b, the decoders are synchronized 
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with each other vertically and horizontally. In step 241c, 
an ARTS of an audio signal is read, and the APTS value 
is set as an initial value of an STG of the first decoder 
and an STC of the second decoder. In step 241 e, 
processing of the first decoder is started. In step 241 f. it 
is checked whether or not a first VPTS has reached the 
initial value. If yes, decoding is started in step 241 g. In 
step 241 h. a processing delay time period of the first 
decoder is calculated, and the VPTS of the decoder out- 
put is adjusted so that the APTS and the VPTS are syn- 
chronized with each other. Since the second decoder is 
processed in the same manner, the picture from the first 
decoder and the picture from the second decoder are 
synchronized with each other. Thus, the decoder out- 
puts, i.e., the first MPEG signal and the second MPEG 
signal are synchronized within one line. Then, the syn- 
chronization on a dot-by<iot basis is obtained by a 
video signal synchronization section 36a of the synthe- 
sis section 36. An original progressive picture is 
obtained even by a sum calculation. As shown in Rgure 
5, in the case where an APTS 84 is read by tiie audio 
decoder 16c and an identical APTS is set In registers 
39a and 39b of the STCs of the two MPEG decoders 
16a and 16b, an audio stream and the two video stream 
are automatically synchronized with one another. 
[0040] In the present invention, when the buffer cir- 
cuits 23a and 23b underflow, either one of tiie pictures 
is disconnected, as a result of which a disturbed pro- 
gressive picture is output. In order to avoid this, the buff- 
ering amounts of the two buffer circuits are controlled by 
a buffer amount control section 23c as shown in Rgure 
5. This operation is illustrated in tiie flowchart shown in 
Rgure 56. First, in st^ 240a, a maximum interieave 
value among the NAVI information of each disk is read, 
and a maximum value of 1 ILB in one main interieave 
tJlock is set The maximum value is usually 512 sectors. 
i.e..about 1 MB. When the maximum value is set below 
1 MB by a specific format that value is set as the maxi- 
mum value. Next, when an instruction to simultaneously 
reproduce the main and sub interieave t^ocks is issued 
in step 240b, if the buffering amount of the first buffer 
circuit 23a is 1 ILB or less in step 240c. reproduction is 
performed from the main interieave block, and an 
instruction to transfer the data to the first buffer circuit 
23a is issued. Then, the processing goes back to steps 
240b and 240c. The transfer is stopped in step 240d 
when the buffering amount of the first buffer drcuit 
exceeds 1 1LB. Since the data in the buffer circuit 23a 
becomes 1 1LB or more in this manner, underflow is pre- 
verrted. 

[0041] In step 240f, a maximum value of a sub inter- 
leave block of 1 ILB-Sub is set in the buffer circuit 23b. 
Simultaneous reproduction is performed in step 240g. 
When the data in the second txjffer circuit 23b is 1/2 
ILB-Sub or less, data is read into the buffer circuit in 
step 240i. When the data is more than 1/2 ILB-Sub in 
step 240i. the reading is stopped in step 240i. 
[0042] As shown in part (4) of Rgure 45. the data 



amount of 1/2 ILB is sufficient in the second buffer cir- 
cuit Accordingly, the txiffering amount can be reduced 
to half. The buffer control in Rgure 56 eliminates the 
underflow of the buffer circuits, thus reducing distur- 

5 bance in the synthesized picture during reproduction. 
[0043] Next a process for reproducing only an R sig- 
nal by IX rotation of the optical disk will be described. 
The standard rotation speed of a DVD reproduction 
apparatus is referred to as "1 X". and the speed twice tiie 

10 standard rotation speed is referred to as *2X". Since it is 
not necessary to rotate the motor at 2X, a 1 X instruction 
is sent from a control section 21 to a rotation speed 
alternation circuit 35 to reduce the rotation speed. A 
process for r^roducing only an R signal at IX rotation 

15 from an optical disk storing the R signal and an L signal 
will be described with reference to the timing diagram in 
Rgure 8. As described with reference to parts (1) and 

(2) of Rgure 6, the optical disk according to the present 
invention has the R-frame group 6 and the L-frame 

20 group 8 alternately recorded. This is shown in parts (1) 
and (2) of Rgure 8. 

[0044] A comparison between the signal shown in 
parts (1) and (2) of Rgure 8 and a signal shown in part 

(3) of Rgure 8 corresponding to one rotation of the disk 
25 indicates tiiat the optical disk rotates 5 to 20 times while 

one frame group is reproduced. A track junp of the opti- 
cal head from the R-frame group 6 to the next R-frame 
group 6a requires several tens of milliseconds. Where 
the wait time period is one rotation, which is the maxi- 

30 mum, the data in the R-frame group 6a can be repro- 
duced within two rotations. This is shown in parts (4) 
and (5) of Rgure 8. which are timing diagrams of tiie 
r^roduction signal and the signal corresponding to one 
rotation of the disk. The time axis of the reproduction 

35 sigral in part (4) of Rgure 8 is adjusted by the buffer cir- 
cuit 23a in Rgure 5, and an fVIPEG signal having contin- 
uous R frames as shown in part (6) of Figure 8 is output 
from the buffer circuit 23a. This signal is exterKled to be 
an R video signal as shown in part (7) of Figure 8 by the 

40 MPEG decoder 16a. By selecting a different channel in 
the same manner as the case of the R signal, a 2D sig- 
nal of the L channel is obtained. According to the 
present invention, the R or L channel is assigned to a 
frame group of 1 GOP or more and the frame group is 

45 recorded continuously over a plurality of tracks. Thus, 

^ even when a 3D optical disk is reproduced by a IX 
reproduction apparatus, a 2D output of only the R chan- 
nel is obtained. 

[0045] As can be appreciated from this, as shown in 
50 the block diagram of Rgure 9. a reproduction apparatus 
specifically for 2D display is obtained by altering the 
structure of the 3D reproduction apparatus in Rgure 5 
so that there is only one ljuffer circuit 23 in lieu of two. 
one MPEG decoder 16 in lieu of two, and one picture 
55 output section 1 7. Such a 2D reproduction apparatus 40 
includes the 3D picture arrangement information repro- 
duction section 26, arxl therefore, reproduces a 3D pic- 
ture identifier and arrangement information of the 3D 
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optical disk 1. Accordingly; when the data in the optical 
disk 1 is reproduced by the 2D reproduction apparatus, 
data in either one out of the R and L channels is output 
Since the R and L channels correspond to an identical 
picture, it is a waste of time to output the pictures in the 5 
R and L channels by switching the channels by a chan- 
nel selection section 20. According to the present inven- 
tion, a 3D channel output control section 41 restricts 
data to be output from only either channel, for example, 
the R channel, using the 3D picture identifier. Thus, data 
in only the R or L channel of identical video contents is 
output, avoiding the situation in which the user sheets 
an unnecessary channel. 

[0046] When a 3D picture is provided, ttie "3D" display 
signal output section 23 displays the symbol "^D" on tiie 
screen or a display section 42 of the reproduction appa- 
ratus. Therefore, tiie user can recognize that the picture 
is a 3D picture. The qstical disk according to the present 
invention provides both 2D and 3D pictures when repro- 
duced by the 3D reproduction apparatus 43 in Rgure 5 
and a 2D picture when reproduced by the 2D reproduc- 
tion apparatus in Figure 9. In this manner, the compati- 
bility between the 2D reproduction apparatuses and 3D 
reproduction apparatuses realized. 
[0047] Now, returning to the 3D reproduction appara- 
tus, use and effect of a 3D picture identifier will be 
described. 

[0048] Figure 13 is a timing diagram of a 3D picture 
identifier and an output signal. One interleave block is 
defined as a time unit "t". In parts (3) through (6) of Rg- 30 
ure 13, a delay time period of It is generated altiiough 
not shown. As shown in part (1) of Rgure 13, the state 
of the 3D picture identifier is changed from "r to "0" at 
t-t7. As shown in part (2) of Rgure 13, the R-frame 
groups 6, 6a and 6b and the L-frame groups 8, 8a and 35 
8b of a 3D picture are recorded from t1 through t7. From 
t7 through t1 1 . pictures A and B of different contents are 
recorded. In nnore detail, first-frame groups 44 and 44a 
of picture A and second-frame groups 45 and 45a of 
picture B are recorded. Since tiie DVD format does not 4C 
define 3D pictures, a 3D picture identifier is not included 
in the data or directory information of the disk. Accord- 
ingly, a 3D picture arrangement information file needs to 
be read when tiie optical disk is started. As shown in 
parts (3) and (4) of Rgure 1 3. from t1 through t7, data in 4S 
first time domains 46, 46a and 46b can be output to the 
R channel, and data in the second time domains 47, 
47a and 47b can be output to the L channel. After t=t7. 
no 3D picture identifier is availat^le. Accordingly, data in, 
for exanple. first time domains 46c and 46d is output to so 
both the R and L channels. As shown in parts (5) and 
(6) of Rgure 13, a different output system is adopted for 
a mixture output. From t1 through t7 when the 3D pic- 
ture identifier is "r, even field signals 48 and 48a and 
odd field signals 49 and 49a are alternately output from 55 
one output at a field frequency of 60 Hz or 120 Hz. In 
more detail, data in the first time domains 46 and 46a is 
output as the even f iekl signals, and data in the second 



time domains 47 and 47a is output as the odd field sig- 
nals. 

[0049] After t=t7 when the 3D picture identifier is not 
available, data in the first time domains 46c and 46d is 
output as both the even field signals 48d and 48e and 
the odd field signals 49d and 49e. 
[0050] As described above, the manner of outputting 
signals to the 3D display is changed in accordance wttii 
whether or not the 3D picture arrangement information 
indicates the absence of the 3D picture. In this manner, 
it is prevented that pictures of different contents from 
each other are presented for tiie right and left eyes of 
tiie user. Without such a function, tiie following incon- 
venience occurs. In tiie case where the first time 
domain and the second time domain of the optical disk 
start to include different contents from each otiier while 
the user is viewing a right-eye picture and a left-eye pic- 
ture off the same contents, a picture of content A is pre- 
sented to the right eye and a picture off content B is 
presented to the left eye. Such an abnormality makes 
the user feel uncomfortable. 

[0051] With reference to tiie flowchart of Rgure 17, 
the above-described process will be described in detail. 
In step 50a. an optical disk is mounted. In step 50b. a 
f Be of a list of contents In tiie optical disk is read. The file 
does not include a 3D picture identifier. In st^ 50c. a 
3D picture anangement information is read from a 
TXTDT file of tiie disk. 

[0052] In step 50d, tiie list off contents is displayed 
t>ased on the 3D picture arrangement information. At 
this point, "3D" is displayed for each off the contents on 
the menu screen, so that tiie user can recognize that 3D 
contents are available. This information can be in one 
area off the optical disk or included in navigation infor- 
mation provided on a data-by<Iata basis. 
[0053] In step 50e, data in a spedff'ic address is repro- 
duced. In step 50f. it is determined whether or not the 
data is 3D data with reference to the 3D picture arrange- 
ment information. If yes. in step 50g, signals are 
decoded. For example, an R signal in the first time 
domain 46 arxl an L signal in the second time domain 
47 are decoded. The data in the first time domain 46 is 
output as the right-eye picture, and the data in the sec- 
ond time domain 47 is output as the left-eye picture. The 
pictures are synchronized. For r^roduction of the next 
data, the processing goes back to steps 50e and 50f, 
where it is determined whether or not the picture is a 3D 
picture. If no. the processing goes to step 50h, where 
the data in either one of the ffirst time domain 46 or the 
second time domain 47 is output as both the right-eye 
picture and the left-eye picture. In other words, tiie 
same picture is output ffor the right eye and the left eye. 
Thus, pictures of diffferent contents are prevented from 
being output to the right eye and the left eye. 
[0054] According to the present invention, an ordinary 
picture and a 3D picture both of the interieave block sys- 
tem are reproduced in different manners. This will be 
described, hereinafter. 
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[0055] With reference to Rgure 14. part (1) shows 
data recorded on the optical disk. A first interleave block 
56 includes data A1 and a leading address aS of the first 
interleave block 56 to be accessed next i.e.. the next 
pointer 60. Accordingly, as shown in part (2) in Rgure 5 
14. when reproduction of the first interleave block 56 is 
terminated, only the address of the pointer 60a needs to 
be accessed. Thus, the optical head performs a track 
jump to access the next first interleave block 56a within 
1 00 ms and reproduces data A2. Data A3 is reproduced w 
in same manner. In this manner, contents A1 through 
A3 are reproduced. 

[0056] Part (3) of Rgure 14 is related to an optical disk 
having 3D pictures for R and L outputs. The optical disk 
includes the same pointer 60 in order to have the same is 
format as in part (1) of Rgure 14 for compatibility. 
Accordingly, a 3D picture is not reproduced unless the 
pointer 60 is ignored. 

[0057] A 3D p'cture identifier 61 of each cell is defined 
based on the 3D picture logical arrangOTient table. 20 
Accordingly. 3D picture identifiers 61 of interleave 
blocks 54. 55. 56 and 57 are logically defined. This is 
shown in part (3) of Figure 14. The pointer cannot be 
used as it is in order to reproduce data R1 and L1 and 
then reproduce data R2 and LI after a track jump. Spe- 25 
cifically. when reproduction of the R interleave t>lock 54 
Is conpleted. the address of the pointer a5 is not 
accessed. Rather, after reproduction of the next L inter- 
leave t>lock 55, the opt'cal head performs a track jump to 
the pointer aS of the R interleave block. In this case, the 30 
pointer 60b of the L interleave block 55 is ignored. For 
reproducing an interleave block where the 3D picture 
identifier is availat>le. it is advantageous to change the 
manner of accessing the pointer address from the case 
of the reproduction of an ordinary picture, the advan- 35 
tage being that R and L pictures are continuously repro- 
duced as shown in part (4) of Rgure 14. 
[0058] With ref ©-ence to flowcharts in Rgures 1 5 and 
16, a process of changing the manner of accessing the 
pointer address when reproducing an interleave block 40 
using a 3D picture arrangement information will be 
described. 

[0059] In step 62a. an access instruction to an 
address of a specific cell is issued. In st^ 62b, it is 
determined whether or not the picture to be accessed is 45 
3D with reference to the 3D picture arrangement infor- 
nrtation. If the picture is determined not to be 3D in step 
62c. the processing goes to step 62t, where the picture 
is processed as an ordinary picture. If the picture is 
determined to be 3D in step 62c. the processing goes to so 
step 62d, where it is checked whether or not the user 
intends to reproduce the picture as a 3D picture. If no. 
the "3D" mark is displayed on the screen and the 
processing goes to step 62t. 

[0060] If yes in step 62d. the 3D picture arrangement ss 
information is read in step 62e. and the locations of the 
R and L interleave blocks are calculated teased on. for 
example, the chapter number. R cell rTumt>er and L cell 



number. In step 62g. the nth R interleave block is repro- 
duced. In step 62h. the pointers recorded in the R inter- 
leave tdock and the L interleave block are read and 
stored in the pointer memory. In step 62i, the previous 
pointer (i.e., the (n-l)th pointer AL (n)) is read from the 
pointer memory. In step 62j, it is checked whether or not 
pointers AL(n) and AR(n) are continuous with each 
other. If no, a jump to the address AL(n) is performed in 
step 62k. 

[0061] As shown in Rgure 16. in step 62m, the nth L 
interleave block is reproduced. In step 62n. the first 
VPTS and the second VPTS are output in synchroniza- 
tion using the pointer AR(n+1). In step 63g. the first 
VPTS and the second VPTS are synchronized using 
APTS of the main interleave t>lock. If in step 63h. the 
signal is found to be a PG. i.e.. progressive signal, in 
step 63i. a sum and a difference of the two decoding 
output signals are found to and a vertical synthesis is 
performed. Thus, a picture having an improved vertical 
resolution such as a 525P pcture is obtained. 
[0062] If the signal is found to be wide 525P(i) in step 
63j. a sum and a difference of the two decoding output 
signals are found and a horizontal synthesis is per- 
formed. Thus, a picture having an inproved horizontal 
resolution such as a wkle 525P(i) picture of, for exam- 
ple. 1440x480 pixels is obtained. In step 62p. it is 
checked whether or not the reproduction of all the 
streams is completed. In step 62q. ft is checked whether 
or not the nth L interleave block and the (n+1)th R inter- 
leave block are recorded continuously wfth each other If 
no, a trad< junp to the AR(n+1) is performed in step 62r 
arxi the processing goes back to step 62f. If yes in step 
62q. the processing directly goes back to step 62f. 
[0063] In the case where the "3D" mark mentioned 
regarding step 62t is not displayed on the screen, the 
starting address A(i) of cell h is accessed and the first 
interleave block is r^roduced. Then, in step 62u, the 
nth interleave blocks of address A(n) are sequentially 
reproduced. In step 62v. the pointer address A(n+1) for 
accessing the next interleave trfock by jumping is read. 
In step 62w, it is checked whether or not the reproduc- 
tion of all the data is completed. If yes. the processing 
goes tack to step 62a. If no, in st^ 62x. it is checked 
whether or not A(n) and A(n+1) are continuous with 
each other. If yes, the processing goes back to the step 
before step 62u without jumping. If no. in step 62y. a 
jump to the address A(n+1) is performed. 
[0064] Rgure 20 is a block diagram of a reproduction 
apparatus 65 according to the present invention. An 
operation of the reproduction apparatus 65 for repro- 
ducing 2X progressive pictures, wide screen pictures 
and 720P pictures will be described. A signal repro- 
duced from an optical disk 1 is divided by a division sec- 
tion 8 into a first interleave block 66 and a secortd 
interleave block 67 each including frames correspond- 
ing to 1 GOP or more. The t>locks are respectively 
MPEG-extended into frame video signals 70a and 70b 
each having 30 frames/sec. The video signal 70a is 
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divided by a field division section 71a into an odd field 
signals 72a and 73a. The video signal 70b Is divided by 
a field division section 71b into an odd field signals 72b 
and 73b- Thus. 2-ch NTSC interlace signals 74a and 
74b are output. The wide screen picture reproduced by 5 
the reproduction apparatus in Rgure 20 will be 
described later. 

[0065] With reference to Figure 22. an encoding oper- 
ation of a progressive video signal will be described. 
Progressive video signals 75a and 75b are input at time 10 
t1 and 12. and divided by a division section 38 into an 
Odd Rrst interlace signal 244 and an Even Rrst inter- 
lace signal 245. Where the nih line (e.g., 1st line) of the 
interlace signal 244 is labeled as "An** and the nth line 
(e.g., 2nd line) of the interlace signal 245 is labeled as 75 
"Bn". a vertical filter 142 performs a sum calculation, 
i.e., 1/2(An-t-Bn). thus obtaining a lew frequency conpo- 
nent in other words, a function of an interlace interfer- 
ence removal filter 141 is performed. In the case where 
the resultant component is reproduced from only one 20 
angle by a conventional reproduction apparatus, an 
NTSC signal with no interlace interference is obtained. 
"An** of the interlace signal 244 is also divided by a color 
division section 242 and input to a color synthesis sec- 
tion 243 without passing through the vertical filter 142. 25 
In the color synthesis section 243, the signal from the 
color division section 242 and the signal from the verti- 
cal filter 142 are synthesized (1/2(A+B)). Then, the 
resultant signal is corrpressed by an MPEG encoder. 
[0066] A vertical filter 143 performs a difference calcu- 30 
lation, i.e., 1/2(An-Bn), thus obtaining a high frequoicy 
conrponent, i.e., difference information. This signal is 
compressed by an MPEG encoder without being com- 
bined with the color signal. Accordingly, the amount of 
the difference information is advantageously reduced by 35 
the amount of the color signal. 

[0067] Rgure 23 is a view representing the concept of 
the structure of Rgure 22, This system is referred to as 
multiple angle video data division multiplex system 
(MADM) since a video signal is divided into vertical or 40 
horizontal high frequency and low frequency compo- 
nents and recorded in the state of being cGvided into pic- 
tures of multiple angles. As shown in Rgure 23, a signal 
is divided into a basic signal (sum signal) and a sub sig- 
nal (difference signal) by a sum calculation section 141 4S 
and a difference calculation section 143. The resultant 
signals are MPEG-encoded and then recorded as an 
interleave block in units of 1 GOP. At tiiis point, the 
amount of the information can be reduced by 20% by 
performing 3-2 transform of the basic signal and the sub so 
signal in synchronization with each other. It is efficient to 
use. as the basic signal, "IBBPBBPBBPBBPBB" which 
is shown as a main GOP structure 244 used for the ordi- 
nary MPEG encoding. In this structure, an I frame 246. 
B frames 248 and P frames 247 are alternately ss 
arranged. In the case of the difference signal, experi- 
ments have shown that it is efficient to have a structure 
including only 1 frames 246n and P frames 247 due to 



the proffle pattern, for example, "IPPPPPPPIPPPPPPP* 
shown in a sub GOP structure 245. The efficiency is 
irnproved by changing the setting for the sub GOP struc- 
ture. 

[0068] Rgure 23 sfiows an example in which a 525P 
video signal is divided into two in a vertical direction. 
Figure 58 (described below) shows an exanple in which 
a 525P video signal is divided into two in a fiorizontal 
direction. In an alternative manner, a 60-frame 525P 
signal is divided by frame division means into 30 odd 
frames and 30 even frames. In this case, the respective 
30P signals are transformed into two 60-field interiace 
signals, and each of the signals are MPEG-encoded to 
be recorded in tiie MADM system. Such encoding is 
performed in a progressive manner, and therefore 
encoding efficiency is improved as in the case of the 
movie. Thus, tiie recordable time period of the same 
disk is extended. 

[0069] When such a signal is reproduced by a non- 
MADM reproduction apparatus, a SOP (one-channel) 
525 interlace signal is reproduced. Such a signal lacks 
necessary frames and is distOTted. 
[0070] When such a signal is reproduced by an 
MADM reproduction apparatus, a 30P signal as a basic 
signal and a 30P signal as a sub signal are reproduced. 
These two 30-frame signals are synthesized into a 60- 
frame normal 525P signal by frame synthesis means 
including a frame buffer, and then output 
[0071 ] When a line doubler is added to an output sec- 
tion for the 525P signal, a 1050P video signal is 
obtained. 

[0072] When a 525 interiace signal is input to a sum 
signal section of the synthesis section of the MADM 
reproduction apparatus and the value of 0 is input to a 
difference signal section of the synthesis section, a 
525P picture is obtained. Such a manner of input has 
the same effect as the line doubler. This method allows 
even an 525 interiace signal to be output as a 525P sig- 
nal. Accordingly, all types of pictures can be viewed by 
simply connecting one cable to a progressive input ter- 
minal of the MADM reproduction apparatus. 
[0073] In Rgure 23. 1/2(A+B) and 1/2(A-B) are used 
as expressions for calculation for a two-tap filter. The 
separation frequency corresponds to about 300 scan- 
ning lines. 

[0074] When a four-tap filter as shown in part (c) of 
Rgure 46 is used, the number of scanning lines corre- 
sponding to the separation frequency can be reduced to 
about 200. An example of using such a frequency will 
be described. When the amount of information repre- 
sented by the basic signal is too large to encode the 
information, it is advantageous to reduce the number of 
scanning lines corresponding to the separation fre- 
quency to less than 300. for exanple. 220. In this case, 
the amount of information represented by the basic sig- 
nal is signif icantiy reduced arKi thus the information can 
be encoded. Although the amount of information repre- 
sented by the sub signal, i.e., difference signal is 
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increased, it is not serious because the difference signal 
does not include color infornnation and thus originally 
contains only a small amount of information. Therefore, 
there is no problem of insufficiency in the encoding 
capability of the encoder. An original picture is repro- 5 
duced normally by the following setting. The filter infor- 
mation can be contained in a filter Identifier 144 in 
Rgure 50. The filter characteristics are changed in units 
of 1 cell or 1 GOP by altering the constant of the sum 
calculation section and the difference calculation sec- 10 
tion by filter separation frequency alteration means of 
the reproduction apparatus with reference to identifiers 
100, 101 and 111. By such setting, a high rate picture, 
which is usually difficult to encode, can be encoded. 
[0075] Returning to Rgure 22, the MPEG encoder is 
section synthesizes an odd interlace signal 79a and an 
even interlace signal 80a and also synthesizes an odd 
interlace signal 79b arxi an even Interlace signal 80b, 
thus obtaining frame signals 81a and 81b. The frame 
signals 81a and 81b are compressed by MPEG com- 20 
pression sections 82a and 82b to generate compres- 
sion signals 83a and 83b. Interleave blocks 84a, 84b 
and 84c each including 10 to 1 5 frames of the corrpres- 
sion signals 83a and 83b corresponding to 1 GOP or 
more are generated. Compression signals obtained 25 
from an id^itical progressive signal are provided with 
an identical time stanp by time starrp provision means, 
and then the signals are recorded on an optical disk 85. 
[0076] The progressive signal recorded on the optical 
disk 85 is r^roduced by a 2X reproduction apparatus 30 
shown in Rgure 21 , The reproduced signal is divided by 
a division section 87 into a stream of interleave triocks 
84a and 84c and another stream of an irtterleave block 
84b. Then, the streams are extended by exterrsion sec- 
tions 88a and 88b into frame signals 89a arKi 89b each 35 
having 720x480 pixels. The progressive signal is 
divided by field division sections 71a and 71b into odd 
fields 72a and 72b, and even fields 73a and 73b on a 
time axis, as by the reproduction apparatus shown In 
Rgure 20. 40 
[0077] In Rgure 21 . unlike the apparatus in Rgure 20, 
the odd fields 72a and 72b of channel A 91 and channel 
B 92 are synthesized by a synthesis section 90 using a 
sum calculation circuit and a difference calculation cir- 
cuit. The even fields 73a and 73b are syntiiesized In the 45 
same manner. Thus, channel A 91 and channel B 92 
are synthesized In a zigzag manner. As a result, pro- 
gressive signals 93a and 93b are obtained and output 
from a progressive video output section 94. 
[0078] In this manner, a progressive video signal. i.e.. so 
non-interlace NTSC signals of 525 scanning lines is 
obtained by the reproduction apparatus according to the 
present invention. In this example, a progressive signal 
of 480 scanning lines is obtained. The r^roduction sec- 
tion 95 performs 2X reproduction. 55 
[0079] Advantageously, a movie or the like recorded In 
a conventional optical disk are also reproduced as a 
progressive picture. 
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[0080] Rgure 23 shows an exanple in which the sig- 
nal is divided in a vertical direction by the MADM sys- 
tem. WHh reference to Rgure 58, an exanple in which 
the signal is divided in a horizontal direction by the 
MADM system will be described. A wide 525P picture 
of, for exanple, 1440x480P has been studied for mov- 
ies. Such a signal Is transformed into an interiace signal 
of 1 440x4801 by a 3-2 transform section 1 74. The signal 
is divided by a horizontal filter section 206a Into two in a 
horizontal direction. Rgure 59 Illustrates the principle of 
the filter in parts (a) and (b). As shown in part (b), 1440 
dots are divided Into odd dots 263a and 263b, and even 
dots 264a and 264b. Where tiie odd dots are labeled as 
"Xn" and the even dots are labeled as 'Yn**, a sum sig- 
nal Is obtained by X+Y and a difference signal is 
obtained by X-Y. As a result, two 525P or 5251 signals, 
each of 720x480, are obtained as shown in part (b) of 
Figure 59. 

[0081 ] Returning to Rgure 58, the number of horizon- 
tal dots of such a horizontal sum ^gnal Is reduced to 
720. Since the signal is passed through the horizontal 
filter, however, aliasing distortion is as low as that of an 
NTSC signal. A conventional reproduction apparatus 
reproduces only the sum signal and accordirtgly pro- 
vides a DVD picture of the same quality. The difference 
signal represents only a profile formed of line-drawing. 
However, since the difference signal is restricted by a 
second video signal output restriction provision section 
179 so as not to be reproduced by an ordinary repro- 
duction apparatus, no problem occurs. The sum signal 
and the difference signal are respectively encoded into 
MPEG streams by a first encoder 3a and a second 
encoder 3b. and subjected to interleaving in units of an 
Interieave block of 1 GOP or more and MADM-multi- 
plexed. 

[0082] As shown in Rgure 50, in the case of a movie, 
a signal is transformed by a 3-2 transform section 174 
and MADM-recorded as an MPEG signal together with 
3-2 transform Information 174a. 
[0083] In the case of the movie. 24 frames are repro- 
duced in one second. Accordingly, a 1440x480P pro- 
gressive picture is reproduced based on two interiace 
signals by a 2X reproduction apparatus. The scope size 
of the movie Is 2.35:1. The format of 1440x480P is suit- 
able for the scope size of 2.35:1 in terms of the aspect 
ratio. Thus, a wide screen 525P is effectively repro- 
duced. 

[0084] When a movie on the optical disk for a 1 X inter- 
lace reproduction apparatus Is reproduced by the repro- 
duction apparatus shown In Rgure 20. a 24-frames/sec. 
progressive signal is obtained in an MPEG recorder 
since a movie signal Is a progressive signal having 24 
frames/sec. The progressive signal is reproduced by 
detecting tiiat the optical disk includes a movie by 
detection means or by transforming the 24-frame/sec. 
signal into a 60-frame/sec. progressive signal by tiie 3- 
2 transform section 174. An interlace picture with no 
interference is obtained by filtering the progressive sig- 
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nat by a vertical fitter with reference to the fitter identifier. 
[0085] An optical disk 85 encoded with refa'ence to 
Rgure 22 is reproduced by the reproduction apparatus 
65 conforming to the progressive system. Then» a chan- 
nel-A interlace signal 74a is reproduced. A conventional s 
interlace DVD player lias only channel A but not channel 
B. Therefore, when the optical disk 85 according to the 
present invention is mounted on the conventional inter- 
lace DVD player, the channel-A interlace signal is 
obtained. As can be appreciated, an optical disk accord- 
ing to the present invention provides a progressive sig- 
nal when r^roduced by a reproduction apparatus 
according to the present invention, and provides an 
interlace signal of the same contents when reproduced 
t>y a conventional reproduction apparatus. Thus, the 
optical disk according to the present invention realizes 
complete compatibility even with the conventional repro- 
duction apparatus. 

[0086] In the MPEG encoder shown in Rgure 22. an 
interlace interference removal compression filter 141 is 
provided to signif icantiy reduce the aliasing distortion. 
[0087] Hereinafter, encoding of a 3D picture will be 
described in detail. 

[0088] A right-eye signal 97 and a left-eye signal 98 
are input into a recording apparatus 99 in the same 
manner as the sum signal and tine difference signal of 
the progressive signal described with reference to Rg- 
ure 22. Since this is an interlace signal, odd field signals 
72a and 72b and even field signals 73a and 73b are 
input every 1/60 second. Tlie signals 72a and 73a and 30 
the signals 72b and 73b are synthesized by synthesis 
sections 101a and 101b into 1/30 sec. frame signals 
83a and 83b- These signals are compressed by com- 
pression sections 103a and 103b into compression sig- 
nals 83a and 83b. Interleave blocks 84a. 84b and 84c. 35 
each including frames of these signals corresponding to 
1 GOP or more, are generated. The interleave blocks 
84a. 84b and 84c are alternately located and recorded 
on the optical disk 1. When data in the resultant optical 
disk is mounted on tiie reproduction apparatus shown in 40 
Rgure 24 for reproduction, the 3D/PG picture arrange- 
ment information reproduction section 26 described 
atxTve with reference to Rgure 5 detects a PG identifier 
in the disk. Therefore, the reproduction apparatus (104) 
is put into a 3D reproduction mode as shown in Rgure 45 
24. The 3D picture in the optical disk is divided by a divi- 
sion section 68 into channel A arrcl channel B. The data 
in the channels are exterKfed respectively by extension 
sections 88a and 88b and then divided into field signals 
by field division sections 71a and 71b. The operation of so 
the reproduction apparatus up to this point is the same 
as in the case of Rgure 21. 

[0089] A feature of the reproduction apparatus shown 
in Rgure 24 is tiiat the field division section 71a outputs 
odd field signals and even field signals while switching S5 
the output order thereof by an output transform section. 
When the signals are sent to a progressive TV. i.e., a TV 
having a field frequency of 120 Hz. the signals are out- 



put from a progressive output section 1 05 in the order of 
a channel-A odd field signal 72a. channel-B odd field 
signal 72b, channel-A even field signal 73a. and chan- 
nel-B even field signal 73b. Thus, the right-eye signals 
and tiie left-eye signals are output alternately and in tfie 
order of the odd field and then the even field. Accord- 
ingly, a f lickerless picture having matching right-eye and 
left-eye information is obtained through switch-type 3D 
spectacles. 

[0090] When the signals are sent to an ordinary TV. 
tfie channel-A odd field signal 72a and the channel-B 
even field signal 73b are output from an NTSC output 
section 106. Then, a 3D picture displaying natural 
motions is obtained through 3D spectacles attiiough the 
picture includes flicker. 

[0091 ] By corrtoining the progressive system and the 
3D picture r^roduction system according to the 
present invention, a high definition 3D picture including 
a rigfit-eye picture and a left-eye pMCture is realized. This 
will be described witfi reference to Rgure 25. A repro- 
duction apparatus 1 07 performs 4X reproduction. When 
reproducing a DVD. 80% of such a transfer rate is suffi- 
cient In the emtxxjiment where interleave blocks 108a. 
1 08b. 1 08c and 1 08d of right progressive signals A and 
B arKi left progressive signals C arxi D are arranged 
with no interval as shown in Rgure 25. the optical 
pickup does not need to jump for continuous reproduc- 
tion. In the case of DVD, only 80% of the information is 
reproduced. The reproduction rate can be 3.2X in lieu of 
4X in tiie case of continuois reproduction. Such a con- 
tinuous arrangement advantageously reduces the 
reproduction rate. 

[0092] The signal is divided into interleave blocks 
1 08a. 1 08b. 1 08c and 1 08d. and signals for chiannels A. 
B. C and D are reproduced. The video signals extended 
by extension sections 69a. 69b. 69c and 69d are syn- 
thesized by synthesis sections 90a and 90b as in Rgure 
21. and two progressive signals are output from pro- 
gressive output sections 110a and 110b. The two pro- 
gressive signals are respectivdy a right-eye signal arrcl 
a left-eye signal. Accordingly, a progressive 3D picture 
is obtained by the reproduction apparatus 107. When a 
4X MPEG chip is used, only one chip is sufficient and 
avoids an increase in the number of conponents. The 
4X MPEG chip realizes recording and reproduction of 
pictures of four different contents. In this case, pictures 
are displayed on a 4-part multi-screen TV simultane- 
ously with one optical disk. 

[0093] A feature of the present invention is to provide 
compatibility among all the apparatuses and media. 
When data on a disk 106 in Rgure 25 is reproduced by 
a conventional reproduction apparatus, an interlace sig- 
nal for either the right eye or tiie left eye is output. The 
picture is not deteriorated although the reproduction 
time is reduced to 1/4. However, a two layer DVD stores 
data for 2 hours and 15 minutes. Almost all movies are 
accomrrrodated in such a DVD. 

[0094] When data on the disk 106 in Rgure 25 is 
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reprcxiuced by a 2X SD^rogressive reproduction appa- 
ratus according to the present invention, the user 
switches from a 3D interlace picture to a one-channel 
progressive picture or vice versa by serxJing an instruc- 
tion to a control section 21 through a channel selection 5 
section 20 from an irput section 19 (see Rgure 9). As 
described above, the p>resent invention has an effect of 
providing complete compatibility analogous to that 
between the monaural records and stereo records dis- 
cussed in the past ro 
[0095] According to the 2X and 4X reproduction appa- 
ratuses according to the present invention, pictures of 
various qualities are obtained in various display man- 
ners. 

[0096] As described atx>ve. according to the present is 
invention , when a 3D identifier is not available, the 
pointer is read and the optical head jumps. When a 3D 
identifier is available, tiie reproduction process is 
changed so that the pointer of one of the Immediately 
previous interleave blocks is read and accessed. Thus. 20 
a 3D picture is recorded without changing the format 
[0097] A method for performing recording and repro- 
duction while a scope-size movie screen is divided into 
two. 

[0098] In Figure 20. an optical disk 1 having two- 2S 
screen interlace signals is reproduced. Now, with refer- 
ence to Rgure 40. this conc^ is applied to a scope- 
size (2.35:1) super wide screen 154. The super wide 
screen 154 is divided into three, i.e., a center screen 

1 56 and side screens 1 57 and 1 58 by a screen division 30 
section 155. The position of division is reF>resented by a 
center shift amount 159. The center picture 156d is 
compressed as a first video signal. The side pictures 

157 and 158 are compressed together as a second 
video signal. The compression signals are processed 35 
witii interleaving and are recorded on an optical disk 
191 togetiier with the center shift amount 159. In this 
case, the second video signal, which represents a pic- 
ture obtained by sewing together two different quality 
pictures, is not desired to be output Accordingly, a sec- 40 
ond video signal restriction information provision sec- 
tion 179 adds reproduction restriction information such 

as. for example, password protection to the second 
video signal stream. Then, the reproduction apparatus 
cannot reproduce the second video signal independ- 45 
entiy In this manner, it is prevented that the user views 
an abnormal picture of only the second video signal. In 
this case, a progressive reproduction apparatus repro- 
duces t>oth the first and second video signals to realize 
a wide screen. so 
[0099] When such an optical disk is reproduced by the 
reproduction apparatus in Rgure 20. the second video 
signal is not independentiy output. From the optical 
disk, the center shift amount 159 is reproduced by a 
center shift amount reproduction section 159b. A wide ss 
picture synthesis section 173 uses the center shift 
amount 159 to synthesize a scope-size picture. The 3-2 
transform section 174 performs 3-2 pull-down transform 
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shown in Rgure 41 to transform a 24-frame/sec. signal 
of the movie into a 60-fields/sec. interlace signal or a 
60-frames/sec. progressive signal. As shown in Rgure 
41. both the extension arxJ wide picture synthesis are 
performed. The 3-2 transform performed by the 3-2 
transform section 174 is as follows. A synthesis picture 
179a having 24 frames/sec. is transformed into three 
interlace pictures 180a. 180b and 180c. A synthesis 
picture 179b is transformed into two interlace pictures 
180d and 180e. Thus, the picture having 24 frames/sec. 
is transformed into a BO-fields/isec. interlace picture. A 
progressive picture 181 can be output as three progres- 
sive pictures 1 81 a. 1 81 b and 1 81 c and two progressive 
pictures 1 81 d and 1 81 e. 

[0100] Another method for dividing a screen is as fol- 
lows. As shown in Rgure 40, a 1440x480 screen 154 is 
divided into two horizontal separation screens 1 90a arxJ 
190b each having 720x480 pixels. Such division is per- 
formed by separating odd nurri>er of columns of pixels 
from even number columns of pixels by a picture hori- 
zontal division section 207. These screens 190a and 
190b are corrpressed as a first video signal and a sec- 
ond video signal in a similar manner to the atx>ve- 
described manner and recorded on the optical disk 1 91 . 
In order to avoid aliasing distortion, two pixels are 
added by a horizontal filter 206 shown in Figure 46 at a 
specific addition ratio, so that the high frequency com- 
ponent in the horizontal direction is attenuated. Such 
processing avoids generation of moir6. which appears 
when the optical disk is reproduced by an existing repro- 
duction apparatus at 720 dots. 

[01 01 ] When the optical disk 1 91 is r^roduced by the 
reproduction apparatus 65 shown in Figure 20. the hor- 
izontal separation screens 190a and 190b are decoded. 
When the decoded signals are synthesized by the wide 
picture synthesis section 173. an original 1440x480- 
pixel screen 154a is obtained. In the case of movies, 3- 
2 transform is performed by synthesizing the screen 
1 54a as shown in Rgure 41 . 

[01 02] The second method of horizontally dividing tiie 
screen is advantageous in providing a level of high com- 
patibility for the following reason. The first video signal 
and the second video signal both represent an ordinary 
720x480-pixel picture obtained by dividing the original 
1440x4d0-pixel p>icture into two by a horizontal line. 
Accordingly, even when the second video signal is erro- 
neously reproduced by an ordinary reproduction appa- 
ratus such as a DVD player, the resultant picture has the 
same aspect ratio as that of the original picture. Such a 
division system advantageously realizes reproduction 
of an interlace picture by an ordinary reproduction 
apparatus, reproduction of a 525 progressive picture by 
a progressive reproduction apparatus, and reproduction 
of a wide screen picture having a scope of. for example, 
720P by a 720P high resolution reproduction apparatus. 
Such advantages are conspicuous in the case of mov- 
ies, which can be reproduced at the rate of 2X. 
[0103] This method is applied as shown in Rgure 44. 
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A 1440x960 progressive picture 182a is divided in hori- 
zontal and vertical directions by a horizontal and vertical 
division section 194 of a picture division section 115 
using, for exanple. sub-band filter or wavelet transform. 
Then, a 525 progressive picture 183 is obtained. This is 5 
divided into interlace signals 184 and recorded as a 
stream 188a. 

[0104] Interpolation information 185 is divided into 
four streams 188c, 188d. 188e and 188f in a similar 
manner and recorded in units of an interleave block. 10 
The nrrawmum transfer rate of each interleave block is 8 
Mbps by the DVD format. When the interpolation infor- 
mation 185 is divided into four streams, the transfer rate 
of 32 Mbps is obtained. In the case of six angles, the 
transfer rate of 48 Mbps is obtained. Thus. 720P and is 
1050P HDTV pictures can be recorded, in a conven- 
tional reproduction apparatus, a stream 188a is repro- 
duced and an interlace picture 184 is output. Regarding 
the streams 188c, 188d. 188e and 1881. output restric- 
tion information is recorded on an optical disk 187 by a 20 
picture processing restriction information generation 
section 179. Therefore, an ugly picture of interpolation 
information 185 such as differential information or the 
like is not output in error. An optical disk conpatible with 
HDTV and NTSC is realized by dividing a signal in a 25 
horizontal direction by the system shown in Rgure 44. 
[0105] In Rgure 20. an interiace signal is obtained by 
the transform performed by the interlace transform sec- 
tion 175, arxj as a result a scope-size screen 178 is 
obtained. A 525P progressive signal is also output on a 30 
scope-size screen in a similar manner. When viewed by 
a 720P monitor, a 525P signal is transformed into a 
720P progressive signal by a 525P/720P transform sec- 
tion 176. as a result of which a letter box-type 720P 
screen 177 having 1280x720 or 1440x720 pixels (pic- 35 
ture has 1280x480 or 1440x480 pixels) is output. A 
scope-size picture (2.35:1) has 1 128x480 pixels. A pic- 
ture having a similar aspect ratio to this is obtained. A 
movie signal has 24 frames/sec. Therefore, the transfer 
rate of the progressive picture is 4 Mbps. When the 40 
scope-size picture is recorded by the 2-screen system 
according to the present invention, the transfer rate is 8 
Mtjps. Since a two-layer DVD can store data for about 2 
hours and 15 minutes, a 720P or 525P high definition 
progressive picture can be recorded on one optical disk. 45 
Such data is output on a conventional TV as an inter- 
lace signal, needless to say As described above, the 
scope-size (2.33:1) picture of tiie movie can be output 
as a 525P or 720P picture. 

[0106] Hereinafter, a specific method for recording so 
and reproducing a 1050 interlace signal will be 
described. An even field 208a of a 1050 interlace signal 
is divided into two pictures 208b and 208c by horizontal 
division means 209. Two pictures 208b and 208c are 
respectively divided by vertical division means 210a 55 
and 210b to obtain pictures 208d and 208e. and 208f 
and 208g. An odd field 21 1 a is divided in a similar man- 
ner to obtain pictures 21 1 d. 21 1 e. 21 If and 21 1 g. In this 



case, the pictures 208d and 21 Id act as main signals 
arxl an interlace picture is output by an existing repro- 
duction apparatus. Horizontal fitters 206b and 206c and 
vertical filters 212a and 212b, inserted for preventing 
interlace interference and the like, reduce aliasing dis- 
tortion of the reproduced picture. 
[0107] With reference to Rgures 27. 28, 42 and 49. 
the file structure and identifiers for pictures will be 
described. Rgure 27 shows a logical format of DVD. 
Each logical block includes a video file. As shown in Rg- 
ure 28. a minimum unit of a system stream is referred to 
as a "ceir. In a cell, picture data, audio data and sub 
picture are recorded in a packet in units of 1 GOP. 
[0108] A cell 216 (see Rgure 18) of a main signal of a 
first stream has a packet 21 7, A provider defined stream 
in the packet 21 7 has a capacity of 2048 bytes. The pro- 
vider defined stream includes a progressive identifier 
218 indicating whether the signal is progressive or inter- 
lace, a resolution identifier 219 indicating whether the 
resolution is 525. 720 or 1050. a differential identifier 
220 indicating whether or not the interpolation signal is 
a differential signal from the main signal, a filter identi- 
fier (desCTibed later), and sub stream number informa- 
tion 221 indicating the stream number of a first sub 
stream. 

[01 09] With reference to Rgure 52. a process for per- 
forming reproduction using a picture identifier 222 will 
be described. 

[0110] From the optical disk, reproduction process 
control information 225 is first read from management 
information 224. Since the information 225 includes 
restriction information on VOB. a 0th VOB 226a is only 
connected to a first VOB 226b having a main picture in 
an existing reproduction apparatus. Since the 0th VOB 
226a is not connected to a second VOB 226c having an 
interpolation signal such as differential information, an 
ugly picture such as differential information is not output 
by the existing reproduction apparatus. Each VOB of tiie 
main signal has a picture identifier. Since the progres- 
sive identifier=1 and resolution identifier=00 (525) in the 
first VOB 226b and the second VOB 226c, a progres- 
sive signal having 525 scanning lines is reproduced 
from a progressive or high definition HD reproduction 
apparatus. 

[01 1 1 ] In a picture identifier 222 of the next VOB 226d. 
the progressive identifier=0 and the resolution identifier 
219=10, An interlace signal having 1050 scanning lines 
is output. VOBs 226e, 226f and 226g are interpolation 
information. Thus, an NTSC signal is output by a con- 
ventional reproduction apparatus, an interlace signal 
having 720 horizontal pixels and 1050 vertical pixels is 
output by a progressive reproduction apparatus, and a 
full HDTV-format signal having 1050 scanning lines is 
output by a high definition reproduction apparatus. The 
picture identifier 222 can be recorded in the manage- 
ment information 224. 

[0112] With reference to Rgure 53, the relationship 
among VPTS (video presentation time stamp) of the 
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sub track of interleave blocks, i.e.. decoding output time, 
vyrill be described. In the first VOB 226b as the main sig- 
nal, interleave blocks 227a, 227b and 227c are 
recorded together with VPTS1. VPTS2 and VPTS3. In 
the second VOB 226c. interleave blocks 227d. 227e 5 
and 227f are recorded together with VPTS1. VPTS2 
and VPTS3. A conventional player reproduces the inter- 
leave blocks 227a. 227b and 227c at IX. Since the 
main signal includes an audio signal, the audio signal is 
also r^roduced. A progressive player first reproduces 70 
the Interleave block 227d of the second VOB 226c as a 
sub signal and stores the block in a buffer memory. After 
the storage, the progressive player reproduces the inter- 
leave block 227a of the first VOB 226b. The audio and 
video signals are synchronized with the synchronization 75 
information of the interleave k^ock 227a. Since the audio 
signal is included in the irtain signal, the main signal and 
the sub signal shown in parts (2) and (3) of Figure 53 
are output in synchronization with the audio signal. In 
tfiis case, a track jurrp is performed between the inter- 20 
leave blocks 227a and 227e. 

[01 1 3] Thus, a progressive signal shown in part (4) of 
Rgure 53 is output By checking the VPTS of the inter- 
leave t>lodc5 by the reproduction apparatus, the main 
signal and the sub signal are decoded in synchroniza- 25 
tion and synthesized, thereby ot>taining a normal pro- 
gressive signal. 

[0114] Rgure 54 shows an arrangement of signals in 
a simultaneous cast system by which an hfTSC signal 
and an HDTV signal are recorded as interleave blocks so 
independently at the same time. In the VOB 227a as the 
main signal, a video signal and an audio signal 232 are 
recorded. In the VOBs 227b and 227c. an HDTV com- 
pression video signal corresporxJing to about 16 Mbps 
is recorded, 8 Mbps for each, by the interleave system. 35 
A conventional player and a progressive player shown in 
parts (1) and (2) of Figure 54 reproduces an NTSC 
(525i) signal. An HDTV player shown in part (3) of Rg- 
ure 54 reproduces a 16 Mbps HDTV signal as a result of 
obtaining only audip data from the first VOB 227a, 40 
reproducing a first sub picture and a second sub picture 
from the VOBs 227b and 227c, and synthesizing these 
data. Since the r^roduction of the sub signals is 
restricted by the reproduction process control informa- 
tion 225. an existing DVD player does not r^roduce an 45 
HDTV compression signal even when the user errone- 
ously operates the player. Thus, an fslTSC signal Is out- 
put by the existing player, and an HPTV signal is output 
by the HPTV player. Rgure 55 is a block diagram of a 
reproduction apparatus. The operation of the reproduc- so 
tion apparatus is not described in detail since it is similar 
to the operations described above. A reproduction sig- 
nal from the optical disk is divided by an interleave block 
division section 233. A main signal is decoded by an 
audio decoder 230 of an NTSC decoder 229, and a first ss 
sub signal and a second sub signal which are each an 8 
Mbps stream, are decoded by an HDTV decoder 231 . 
Thus, an HDTV signal and an audio signal are output. 



The data in the optical disk is reproduced as an NTSC 
signal even by a conventional reproduction apparatus 
by simultaneous casting. Moreover, according to the 
present invention, a transfer rate of 16 Mt>ps is obtained 
when two interleave streams are used. Accordingly, a 
standard HDTV MPEG-compression signal is recorded 
as it is. With a DVD. a transfer of only 16 Mbps is 
obtained with two interleave blocks. Since an HDTV 
compression video signal is a 16 Mbps signal, audio 
data cannot be recorded. According to the present 
invention, audio data of the NTSC signal of the main 
signal is used. Therefore, an audio signal can be 
recorded even when an HDTV signal is recorded with 
two interleave blocks. 

[01 15] Now, a method for removing interlace interfer- 
ence will be described. When a progressive signal is 
transformed into an interlace signal by removing unnec- 
essary components, aliasing distortion is generated and 
thus a moir6 of a low frequency component is gener- 
ated. A 30 Hz line flicker is also generated. In order to 
avoid these inconveniences, the signal needs to be 
passed through interlace interference removal means. 
Interlace interference removal means 140 is added to a 
progressive signal section of a progressive/interlace 
transform section 139 of the recording apparatus in Rg- 
ure 22 (described above). When a progressive signal is 
input, the interlace interference removal means 140a 
detects a video signal having a high probability of being 
interfered with from the input progressive signal, and 
passes only such a video signal through an interlace 
interference removal filter 141 . For example, in the case 
of a picture having a low vertical frequency component, 
interlace interference does not occur In such a case, 
the fitter is bypassed by a filter bypass route 143. Such 
an operation alleviates the deterioration in the vertical 
resolution of the picture. The interlace interference 
removal fitter 141 includes a vertical fitter 142. 
[0116] In part (a) of Rgure 46 (time and space fre- 
quency diagram), the hatched area r^resents an alias- 
ing distortion generation area 213. 
[01 1 7] The aliasing distortion generation area 213 can 
be removed by a vertical filter. Specif Icalty. as shown in 
part (c) of Rgure 46. three line memories 195 are pro- 
vided. Regarding a progressive signal having 480 lines, 
picture information on the target line (nth line) and pic- 
ture information on the immediately previous and sub- 
sequent lines {(n-l)th line and (n+1)th tine) are added 
together by an adder 196. Thus, information of one tine 
is obtained, and 240 interlace signals are generated. 
Such processing fitters the information in a vertical 
direction, resulting in alleviation in the interlace interfer- 
ence. By changing the adding ratio of the three lines, fit- 
ter characteristics can be changed. This Is referred to as 
a Vertical three-line tap fitter": 6y changing the adding 
ratio of the center line with respect to the immediately 
previous and subsequent tines, a simpler vertical fitter 
can be obtained. As shown in part (d) of Figure 46, tine 
information can be processed with a vertical fitter after. 
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for exanple. the (n-1)th line of the previous frame and 
the (n+1 )th line of the subsequent frame (even lines) are 
developed on an identical space, in lieu of a simple ver- 
tical filter. Such a time vertical filter 214 has an effect of 
alleviating interlace interference, which occurs when a 5 
progressive signal on the optical disk is reproduced by a 
non-progressive player and only an interface signal is 
listened. A horizontal filter 206a is realized by adding 
two pxels in a horizontal direction to synthesize one 
pixel. Needless to say. however, such a fitter deterio- 10 
rates the resolution of the progressive picture. The filter 
effect is alleviated by preventing filtering on a picture 
having a low probability of being interfered with or by 
changing the adding ratio to realize a vertical filter. 
When the filter effect is weakened, the deterioration in 15 
the resolution of the progressive picture is alleviated. A 
progressive reproduction apparatus according to tiie 
present invention filters the information sufficiently to 
remove interiace interference during reproduction, so 
that it is not necessary to filter the information when 20 
being recorded. When such progressive reproduction 
apparatuses replace the existing reproduction appara- 
tuses in the future, filtering during recording will not be 
necessary. In such a case, there will be both filtered 
optical disks and unfiltered optical disks. The interlace 2s 
interference removal means 140 outputs an interlace 
interference removal identifier 144 to check whether or 
not the picture has been filtered and records the infor- 
mation on the optical disk 85 by recording means 9. 
[0118] With reference to Rgure 50, a specific method 30 
for recording a filter identifier will be described. A filter 
klentifier 144 is put in a header in 1 GOP, which is an 
MPEG recording unit in one stream. "00" indicates that 
the signal is not filtered. "10" indicates that the signal 
has been passed through a vertical filter. "01" indicates 35 
that the signal has been passed through a horizontal fil- 
ter. "11" indicates that the signal has been passed 
through a vertical and a horizontal filter. Since tiie filter 
identifier 144 is put in the minimum unit of 1 GOP, the fil- 
ter can be turned on or off in units of 1 GOP in the repro- 40 
ducb'on apparatus. Accordingly, deterioration of the 
picture quality by double filtering is avoided. 
[01 1 9] With reference to parts (a) and (b) of Rgure 32, 
an operation of a reproduction apparatus 86a for repro- 
ducing an optical disk 85 will be described. As in Rgure 45 
21 , two interlace pictures 84a and 84b are reproduced 
to synthesize a progressive picture 93a. Notably, when 
the interlace interference removal filtering identifier 144 
is "ON" or when special reproduction such as "slow" or 
"still picture" is not performed arxJ a progressive picture so 
is not output either, an interlace signal is output directly 
by an interlace output section at IX. This is energy effi- 
cient 

[0120] When special reproduction is performed or 
when the interlace interference removal filtering identi- ss 
tier 144 is off. a "2X" instruction 146 is sent from a con- 
trol section 147 to a motor rotation speed alteration 
section 35- Then, the optical disk 85 rotates at 2X. and 



a progressive picture is reproduced. 
[0121] A method for removing interiace interference 
when the progressive picture reproduced in this manner 
is output to an interlace TV 148 as an interlace signal 
will be described. When the interlace interference 
removal filtering identifier 144 is off, a determination 
switch circuit 149 is switched to pass the progressive 
signal through the interlace interference removal filter- 
ing identifier 144. Then, two frames 93a and 93b are 
transformed by an interlace transform section 139 into 
odd and even interlace signals 72a and 73a. Thus, an 
ordinary interlace signal is output. In this case, a picture 
with no interlace interference is displayed on the inter- 
lace TV 148. Since the interlace interference removal fil- 
ter does not influence the interlace signal significantiy. 
the interlace signal is not deteriorated. A progressive 
signal with no interlace interference removal filter is out- 
put to a progressive signal output section 215. By the 
system of turning on and off the interlace interference 
removal filter by the reproduction apparatus, a progres- 
sive picture with no quality deterioration and an inter- 
lace picture with no quality deterioration such as 
interlace interference are both obtained. 
[0122] When slow reproduction of a speed of 1/2 or 
less and still picture reproduction is performed, the 
removing filter is weakened since the interlace interfer- 
ence is alleviated. 

[01 23] Next, a method for improving special reproduc- 
tion will be described. When an instruction to perform a 
slow or still pictijre reproduction is issued from the con- 
trol section 147 through an operation input section 150 
to slow/still picture reproduction means 151, the inter- 
lace transform section 149 divides the 480 lines of the 
frame 93a into two fields using a frame processing sec- 
tion 152 to create and output an odd interiace signal 
72b and an even interlace signal 73b. Then, a low or still 
interlace pictore having a resolution of 480 with no blur- 
ring is displayed on the interlace TV 148. In a conven- 
tional interlace reproduction apparatus, the resolution 
needs to be lowered to 240 in order to obtain a slow or 
still picture with no blurring. According to the present 
invention, a slow or still picture having a resolution of 
480 with no trfurring is obtained by transforming the 
interlace signal into a progressive signal once and then 
ti^ansforming the progressive signal t>ack to the interlace 
signal. Rgure 32 illustrates this process in the flowchart 
in part (a) (steps 153a tiirough 153g}. The detailed 
description of the flowchart is omitted. 
[01 24] Witfi reference to Rgure 26. a metiiod for out- 
putting sfreams in two channels continuously will be 
described. The two-channel streams are recorded on 
an optical disk as pictures in cameras 1 and 2 by an 
interleave system. A first sfream from the disk is repro- 
duced and then switched to a second stream. 
[0125] With reference to Rgure 35, a method for 
switching a specific stream to another stream smootiily 
with no disconnection when the contents of tiie optical 
disk include a plurality of streams, i.e., when a plurality 
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of streams eire multiplexed will be described. As shown 
in part (1) of Rgure 35. an optical disk 106 includes two 
different streanrts as a first stream 111 of a first video 
signal and a second stream 1 12 of a second video sig- 
nal. The two streams are t>asically recorded substan- 
tially at the same radius. 

[0126] Usually, only the first video signal as a t>asic 
stream is reproduced. Accordingly, a first stream 1 1 1 a is 
reproduced and then a first stream 1 1 1 b is continuously 
reproduced. When the user issues an instruction to 
switch the first video signal to the second video signal 
from an instruction input section 19 in Rgure 5 at time 
t=:tc. a tracking control circuit 22 in Figure 5 is used to 
access a track at a different radial position, thereby out- 
putting a second stream 112b of the second video sig- 
nal at time t=tc. 

[01 27] Thus, as shown in part (2) of Figure 35. the first 
video signal is switched to the second video signal 
seamlessly with no disconnection at time t=tc in terms 
of the video, audio and sub picture signals. 
[0128] A method for realizing such a seamless repro- 
duction by synchroiizing the video, audio and sub pic- 
ture signals will be described later. 
[0129] With reference to a timing diagram of parts (3) 
and (4) of Figure 35. a specific method for reproducing 
data will be described. As described witii reference to 
the block diagram of Figure 22. a progressive picture as 
the first video signal is divided into main interlace video 
signals A1 through An (Odd Rrst) and sub interlace 
video signals B1 through Bn (Even Rrst). The signals 
are recorded separately in first-angle and second-angle 
sub channels. Although not described with reference to 
Rgure 22. a progressive picture as the second video 
signal is also divided into main interlace video signals 
01 through On and sub interlace video signals D1 
through Dn. The signals are recorded separately in 
third-angle and fourth-angle sub channels as shown in 
part (3) of Rgure 35. Part (3) of Figure 35 is a timing dia- 
gram of the principle shown in Rgure 36. The operation 
is the same. 

[01 30] Rgure 36 puts a focus on an interleave section 
of the recording apparatus shown in Figure 22. A pro- 
gressive signal as the first video signal is divided by a 
first video signal division section 78a into a main signal 
(Odd First) and a sub signal (Even Rrst). The amount of 
information can be reduced by finding a differential sig- 
nal fc>etween the main signal and the sub signal by a dif- 
ferential section 116a and compressing the main signal 
and tiie sub signal to be recorded on the disk. In the 
case of a progressive signal, the correlation between 
adjacent odd and even lines is quite strong, and accord- 
ingly the amount of information of a differential signal 
between the two lines is small. Thus, the amount of 
information to be recorded can be significantly reduced 
by finding the differential signal. 
[0131 ] According to the present invention, the signals 
are recorded in a divided manner using the differential 
device 1 16a as shown in Figure 44. A 720P signal, i.e.. 



a progressive picture having 720 lines or a 1050P signal 
is divided by the picture division section 115 into 525 
basic information 187, progressive picture 183 (or 525 
interlace picture 184) and interpolation information 186. 

5 Differential information 185 between the basic informa- 
tion 187 and the interpolation information 186 is 
obtained by the differential device 116a. The differential 
information 185 is divided by a second video signal divi- 
sion section 78c and a third video signal division section 

10 78d into four streams 188c. 188d, 188e and 188f. 
These streams are sent to a compression section 103 
and processed with interleaving by an interleave section 
113a. Thus, six streams are recorded in the angles on 
an optical disk 187. 

15 [01 32] At tills point, the streams 1 88c, 188d, 1 88e and 
188f are differential information or interpolation informa- 
tion, and thus do not provide a normal picture when 
being decoded by the reproduction apparatus arKl out- 
put onto a TV screen. Such an abnormal picture makes 

20 tiie viewer feel uncomfortable. In order that the streams 
188c. 188d. 188e and 1881, including the interpolation 
information 186. recorded in different angles not be out- 
put by a non-progressive reproduction apparatus, 
restriction information is generated by the picture output 

25 restriction information generation section 179 and 
recorded on the optical disk 187. Specifically, such infor- 
mation prevents a specific stream from being opened 
without a password. Processing the streams 188c, 
188d, 188e and 1881 with such password protection 

30 prevents a conventional reproduction apparatus from 
opening these streams and avoids the situation where 
the user views the abnormal picture obtained by decod- 
ing the interpolation information. 
[01 33] Returning to Rgure 36, the first video signal is 

35 thus compressed, so that the main signal of the first 
video signal is divided into A1 arxi A2 interleave blocks 
83b arxJ 83d, each including 1 GOP or more. The main 
signal of the second video signal is divided into 01 and 
02 interleave blocks 83a. The sub signal of the second 

40 video signal is divided into 81 and B2 interleave t>locks 
83e and 83g and D1 and D2 interleave blocks 831 and 
83h- As shown in Rgure 36, a recording stream 117 is 
generated from these four pieces of data. In the record- 
ing stream 117. the blocks are arranged in the order of 

45 A1. 81. 01. D1, A2. 82. 02, and D2. The recording 
stream 1 1 7 is recorded on an optical disk 1 1 5 by record- 
ing means 145. A1. 81, A2 and 82 correspond to the 
first video signal of the progressive signal. Accordingly 
the signals are recorded on the optical disk 115 in the 

50 order of the first video signal, the second video signal, 
the first video signal and the second video signal. A 
seamless r^roduction performed by the AV synchroni- 
zation section will be described later. 
[01 34] In the above description, 1 GOP or more of the 

55 MPEG signal is recorded in each interleave block. Pre- 
cisely, one interleave block is restricted to about 0.5 
seconds or less. Therefore, only 30 fields of a video sig- 
nal can be recorded at the maximum. Accordingly, only 
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30 GOPs can be recorded in one interleave block at the 
maximum. One interleave block of the present invention 
is limited to 1 GOP or more and 30 GOP or less. 
[0135] A method for compression will be described. 
Interlace signals 73a and 80a of a first VOB 11 8 are put s 
together as a field pair 125a and encoded by a frame 
encoding section 123a into a frame encoded signal 
127a. 

[01 36] A dummy field 1 21 of a second VOB 1 1 9 is first 
encoded by a field encoding section 1 24b in a conpres- io 
sion section 82b on a field-by^ield basts into a field 
encoded signal 129. Next, an even interlace signal 80b 
and an odd interlace signal 79b. which are sub signals, 
are put together as a first field pair 126a. frame- 
encoded by a frame encoding section 1 23b in the com- 75 
presston section 82b into a frame encoded signal 1 28a. 
[01 37] Thus, an Odd Hrst dummy field is added to the 
second VOB 119. Thus, the second VOB signal 119 
starts with an odd interlace signal. Since the signals are 
recorded in the order of an odd interlace signal and then 20 
an even interlace signal, the signals are r^roduced 
smoothly by a DVD player. In this case, one progressive 
signal corresponds to frame encoded signals 127a and 
1 28a. Due to the field encoded signal 129 obtained from 
the dummy field, there is an offset time period 130 of td 25 
between the frame encoded signal 127a from the main 
signal and the frame-«icoded signal 128a from the sub 
signal. Accordingly, it is required to output the sub signal 
earlier by the offset time period when reproducing the 
progressive signal. 30 
[0138] With reference to Rgure 34. the operation of 
the reproduction apparatus 86 described referring to 
Figure 21 wll be described in more detail. A signal from 
the reproduction section 95 is divided into a first VOB 
118 as the main signal and a second VOB 119 as the 35 
sub signal. The first VOB 1 18 originally starts with an 
odd line and thus can be extended as it is. The second 
VOB 118 has a dummy field 129 at the start thereof for 
authoring. Reproduction of the second VOB 1 18 as it is 
results in generating an offset time period 119 of td 40 
between the main signal and the sub signal. Since it is 
time-consuming to synthesize the first progressive sig- 
nal in such a case, a picture corresponding one VOB 
and a picture corresponding the next VOB are not con- 
tinuous. In order to avoid this, the present invention pro- 45 
vides two metiiod for skipping a dummy field 1 21 . 
[0139] According to a first method, a field encoded 
signal 129 at the start of the second VOB 119 is once 
irput to an extension section 132. When progressive 
identification information is detected during or after field so 
extension, a progressive processing switching section 
135 is switched to Yes. Thus, the dummy field 121 is 
skipped by dummy field bypassing means 132 so that 
an even interlace signal 80b is first output and then an 
odd interiace signal 79b is output. This signal is syn- 55 
chronized by synchronization means 133 with an audio 
signal 134 and a sub picture signal 135 such as subti- 
tles which are recorded in the main signal. As a result. 



progressive pictures 93a and 93b are output through a 
progressive transform section 90. In the embodiment 
where the dummy field 121 is bypassed in this manner, 
an odd field and an even f iekJ are output in synchroniza- 
tion with each other. Thus, a progressive signal, an 
audio signal and a sub picture signal with matching time 
axes are output. When progressive identification infor- 
mation is absent, the progressive switching section 135 
is switched to No. and thus the dummy field 121 is not 
bypassed. Progressive transform is rKJt performed. 
Thus, an interiace signal 136 is output Such an output 
of the interlace signal 136 occurs in a conventional DVD 
player without a progressive function. As described 
atx>ve. the dummy field bypassing means 132 is turned 
on for processing a progressive signal. Othenwise, the 
dummy field bypassing means 1 32 is turned off. so tfiat 
an ordinary field encoded interlace signal is normally 
output without dropping tiie field. 
[0140] A second method is used when tiie dummy 
field 1 29 is field-encoded into 1 GOP frames and can be 
separated from the frames of the sub signal. Before 
decoding, tiie field encoded signal 129 obtained by 
encoding the dummy fieW is skipped by 1 GOP by 
dummy field encoded information bypassing means 
137. The skipped information is input to a buffer 131b, 
or skipping is performed when data is output from the 
buffer. To the extension section 88b. only tiie frames of 
tiie sub agnal paired with the main signal or field infor- 
mation is input. Thus, by ordinary means described 
atxjve refemng to Rgiire 21, tiie even interiace signal 
80 and tiie odd interlace signal 79b are extended, inter- 
lace-transfbrmed. synchronized with the main signal, 
and transformed into progressive signals 93a and 93b 
by the progressive transform section 90. 
[0141] According to the second metiiod. the dummy 
field is removed while the dummy field is in the form of 
the encoded information. Therefore, the dummy field is 
not required to be processed by the buffer section 131 b 
or the extension section 88. This method is appropriate 
for putting a field encoded in units of 1 GOP to the start 
of the second VOB. 

[01 42] According to the first method, the dummy field 
129 and the field signals in each frame 127a are field- 
encoded together to generate a unit of 1 GOP. This is 
efficient where a dummy field is inserted at the start of 
one interieave block in. for exarrple. a seamless multi- 
ple angle system having a high recording efficiency. The 
first method has an effect of extending the recording 
time period. 

[0143] By skipping the dummy field 121 only for pro- 
gressive processing in this manner, progressive pic- 
tures can be reproduced with no disconnection at the 
border between adjacent VOBs or between interleave 
blocks in tiie case of a seamless multiple angle system. 
[0144] Such processing will be described with refer- 
ence to the ftowchart in Rgure 37. In step 138a. an 
instruction to start reproduction of (2n-1)th angle data is 
issued. In step 1 38b, whether or not a progressive iden- 
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tifier is present is checked. Jf yes. the processing jumps 
to step 138f. If no, in step 138c, whether or not the fol- 
lowing three coriditions are fulfilled is checked. Condi- 
tion 1 is that there is one field (or an odd number of 
pieces of fields) of GOP at the start of the n*th angle 5 
VOB. Condrtion 2 is that one field of GOP is not existent 
continuoLB to one field of GOP. Condition 3 is that the 
leading GOP of the {2n-1)th angle does not correspond 
to one field. Then, in step 1 38d, whether or not the three 
conditions are fulfilled is checked. If no, in step 138e. w 
interlace processing is performed to output only the (2n- 
1)th angle. If yes, in step 138t the processing is 
switched to progressive processing. In step 138g, 
whether or not the reproduction is to be performed from 
the start of the (2n-1 )th angle VOB is checked. If no, the /s 
processing jumps to step 138j. If yes. in step 138h, the 
nth angle VOB is output while dropping the picture of 
the first one field or GOP corresponding to one field. 
When the (2n-1)th angle includes an audio signal, the 
VOB is output while skipping the first offset time period 20 
dt (default value: 1/60 sec.). In step 138], the main sig- 
nal of the (2n-1)tii angle and the sub signal of the 2n*th 
angle are decoded, synchronized and synthesized into 
a progressive signal. In step 1 38k, a progressive picture 
is output When a seamless multiple angle output is per- 2s 
formed in step 138m, the processing advances to step 
1 38n. where each interleave block of the (2n-1)th angle 
(i.e., sub ^gnal) is field<lecoded, and the output is per- 
formed while the first block is skipped. Alternatively, the 
outputting order of the odd lines and the even lines is 30 
inverted at the time of interlace transform. In step 138p, 
the progressive picture is syrrthe^zed and output. 
[0145] Due to authoring, several seconds of dummy 
field is inserted at the start of the multiple angle VOB. 
The dummy field group at the start of the VOB is read. 35 
In a similar manner, the leading address at which the 
multiple angle VOB starts is read from the PGC data. 
For ordinary reproduction, data is read from the start of 
the VOB. For only 3D or progressive reproduction, the 
dummy field is skipped and the data is read from the 40 
starting address of the VOB corresponding to each of 
the multiple angle VOB. Thus, 3D or progressive pic- 
tures are prevented from being interrupted at the fc>order 
of adjacent VOBs. 

[01 46] So far. the M ADM system has been described, 45 
Hereinafter, a provider defined stream picture division 
multiplex system (PSDM) as another system will be 
described. Rgure 61 is a block diagram of the PSDM 
system of a vertical division system. Figure 62 is a block 
diagram of the PSDM system of a horizontal division so 
system. Figure 63 shows a signal format of the PSDM 
system. 

[0147] As shown in Figure 63. a DVD video signal has 
10.08 Mbps. and a provider defined stream is defined 
separately from a basic stream. A sum signal described 55 
with reference to Figure 23 can be added to the basic 
stream and put into the provider defined stream. Such a 
signal can be reproduced by changing the circuit even 



with a normal IX drive. According to the experiments 
performed by the present inventors, a satisfactory pro- 
gressive picture is obtained when the sum signal is 6 
Mbps and the difference signal is 3 Mbps. Thus, a satis- 
factory progressive picture is obtained unless the 
encoding is difficult 

[0148] In the case of a movie, which contains a pro- 
gressive picture of 241 frames, a suffident picture is 
obtained by the PSDM system. The system shown in 
Figure 61 is l^asically the same as those shown in Fig- 
ures 22 and 23. In tiie latter half of the production of the 
disk, a sum signal is recorded in the basic stream witii a 
basic stream identifier being added thereto in an author- 
ing section, arxl a difference signal is recorded in a pro- 
vider defined stream with a provider defined stream 
identifier being added thereto. In the case of a movie, a 
3-2 transform identifier synchronized with the sum and 
difference signals is added. 

[0149] The reproduction apparatus decodes tiie sum 
signal from a packet provided with the basic stream 
identifier 267 by a first decoder 69a. and decodes the 
difference signal from a packet provided with the pro- 
vider defined stream kientrf ier 268. Signals A and B are 
obtained by a sum calculation section 250 and a differ- 
ence calculation section 251. Thus, a 525P signal is 
synthesized. 

[01 50] Rgure 62 shows a system for dividing a wide 
525P signal in a horizontal direction and PSDM-record- 
ing the resultant signal as two interlace signals, like in 
Rgure 58. 

[01 51 ] Wrth reference to Rgure 26 and part (3) of Rg- 
ure 35. a process for reproducing the optical disk 155 
and switching tiie first video signal to the second video 
signal at t=tc will described. As shown in Figure 26. 
the optical disk 155 (provided as an exanple of an opti- 
cal medium) has four channel stream recorded by an 
interleave system. The streams are recorded in the 
order of A1 . B1 . CI , D1 , A2, B2. C2. D2, A3, B3. C3 and 
D3 in interleave units of 1 GOP. Since the first video sig- 
nal is first output interleave blocks (hereinafter, referred 
to sirrply as "ILB") 84a and 84b(i.e.. A1 and B1) are 
continuously reproduced and a track jump 156 is per- 
formed, thus reproducing ILBs 84e and 84f (i.e.. A2 and 
B2). When tiie first video signal is switched to tiie sec- 
ond video signal at t=tc. a track jump 157 is performed, 
tiius reproducing ILBs 841 and 84h (i.e.. C3 and D3). 
Thus. A1. A2 and C3 as main signals and B1. B2 and 
D3 as sub signals are reproduced, extended by tiie 
extension section, and sent through the synthesis sec- 
tion 101 b to the output section 110b. The resultant sig- 
nal is synchronized with a sub picture signal from a sub 
picture decoder 1 59 and an audio signal from an audio 
signal reproduction section 160 by the AV synchroniza- 
tion section 158. Thus, these signals are output witii 
matching timing. Accordingly, tiie progressive signal in 
the first stream and the progressive signal in the second 
stream are reproduced seamlessly with no disconnec- 
tion. A method for synchronization for providing a seam- 
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less reproduction will be described later. 
[01 52] With reference to Rgure 45, a method for syn- 
chronizing two picture signals and an audio signal when 
two streams are simultaneoi^Iy reproduced as in the 
case of. for exanrple, a 3D picture or scope picture will s 
be described. When three or four streams are simulta- 
neously reproduced as in the case of a 720P signal, a 
similar method is usable and will not be described. 
[0153] Rrst a method for synchronizing two streams 
according to the present invention will be described. io 
Rrst. as shown in Rgure 39, a system reproduced from 
the optical disk is once accumulated in a track buffer 23 
and then sent to a first video decoder 69d and a second 
video decoder 69c. In the track of the optical disk, a first 
stream A and a second stream of the progressive signal is 
are alternately recorded on an interleave block-by-irrter- 
leave t>lock basis. 

[01 54] Rrst. the stream A is reproduced at 2X rotation, 
and data accumulation in a first track txjffer 23a of the 
track txiffer 23 is started. As shown in part (1) of Rgure 20 
45. when t=t1 to t2, data for 1 interleave block (ILB) II of 
the first vkieo signal for 1 interleave time T1 is accumu- 
lated. A first track buffer data amount is increased, and 
becomes equal to 1 ILB at t=t2. Thus, data accumula- 
tion for 1 ILB of the first video signal is completed. At 25 
t=t2. after accumulation of data for 1 ILB of the first 
video signal corresponding to 1 GOP or more is com- 
pleted, the second video signal (stream B) is repro- 
duced from the optical disk starting from the interleave 
block 12. As shown in the solid line in part (4) of Rgure 30 
45. data accumulation of the second video signal in a 
second track Ixjffer 23b is started at t=t2 and continued 
until t=t6. From t=:t2 through t8, as shown in parts (7) 
and (10) of Rgure 45. the video presentation stanps 
(VPTS) of tile first video signal and the second video 35 
signal are synchronized and respectively sent to the first 
video decoder 69c and the second video decoder 69d 
from tfie track buffer 23a and the tiack Ixjffer 23b- As 
shown in parts(8) and (1 1) of Rgure 45. the input sig- 
nals are output as two pieces of video data after being 40 
extended by tfie first and second video decoders 69c 
and 69d. The output of these pieces of data starts at 
t=t3, which is delayed by a video delay time period twd. 
which is required for MPEG extension of the data From 
t=t4 through tlO. tiie streams A and B are synthesized 45 
into a progressive signal by a progressive transform 
section 170. Thus, a progressive signal for one inter- 
leave block is output. 

[0155] As described above, from t=t2 through t8. data 
for one interleave block is input to the decoders. Accord- so 
ingly, the data in the first track buffer 23a and the data in 
the second track buffer 23b are consumed and reduced 
at substantially tiie same rate. Therefore, as shown in 
part (2) of Figure 45, the data amount in the first track 
buffer is reduced from t=t2 through t7. At t=t7. the data 55 
amount is of 1 ILB. Since data reproduction for the 
interleave fcrfock 15 starts at t=t7, the data amount 
increases until t=t8, when the data amount reaches 1 



ILB. Since data input to the first decoder 69c starts at 
t=t8 as at t=t2, the data amount reduces until t=t11. 
Finally, the txjffer memory amount becomes 1/2 ILB. 
[0156] With reference to part (4) of Rgure 45, a 
change in the memory amount in the second track 
buffer 23b for sti-eam B will be described. At t=t2. input 
of data B1 for tiie interleave block 12 of stream B in the 
second track buffer 23b starts. At ttie same time, trans- 
fer of data B1 to the second video decoder 69d starts. 
Accordingly, the buffer amount at t=t6 is 1/2 ILB. When 
2-angle recording of a progressive signal acccffding to 
, the present invention is performed, it is necessary to 
perform a track jump to the interleave HodK 15 over the 
interleave blocks 13 and 14 since there are four streams, 
i.e.. four interleave tjlocks. During the junrp period 197 
(tj), data input from the optical disk is intentipted. Thus, 
the buffer amount of ttie stream B is reduced until t=t8. 
when the buffer amount is dose to zero. 
[01 57] Since input of data B2 of the interleave block 16 
starts at t=t8. the buffer amount starts increasing again. 
At t=t1 1 , the memory anrount of the second track t»uffer 
is 1/2 ILB, At t=t1 1 . a track jump to the interleave blodc 
19 of A3 over the interleave blocks 17 and 18 is per- 
formed. 

[01 58] The atx>ve<iescribed operation is repeated. 
[01 59] Now. the minimum necessary memory capac- 
ity for a track t)uffer 23 (total capacity of the first and sec- 
ond track buffers 23a and 23b) according to tiie system 
of tile present invention will be checked. A track buffer 
capacity 1 98 indicated by dotted line in part (4) of Rgure 
45 shows the total data amount in tiie first and second 
track buffers 23a and 23b. A continuous reproduction is 
realized by setting tfie total capacity of a minimum 1 ILB 
in the track buffer. 

[0160] According to the present invention, the total 
capacity of the track buffers 23a and 23b is set to be 1 
interleave block or more for progressive reproduction. 
Thus, overflow and urKlerf low of the track buffer are pre- 
vented. A method for switching the system clock STC 
between two streams will be described with refererx;e to 
Rgure 31 . A progressive signal includes two streams A 
arxJ B. Ha-e, the streams of two interlace signals form- 
ing a 1 ILB progressive signal are referred to as A1 and 
B 1 . As shown in part (1 ) of Rgure 31 . data A1 for stream 
A is reproduced during the 1/2 ILB time period and all 
tfie data is recorded in the buffer. Then, as shown In part 
(2) of Rgure 31 . data for stream B is reproduced as B1 
and stored in the buffer after A1 is reproduced. Since 
tiie data reproduced from tfie optica! disk is restricted 
with stream B (part (2) of Rgure 31) as described 
above, the track txiffer does not overftow. Stream A 
(part (3) of Rgure 31) or stream dock (SCR) from the 
ti-ack buffer for stream B is reset substantially in syn- 
chronization with the start J of tfie reproduction of 
stream B (part (2) of Rgure 31), Since stream B is out- 
put at the speed of 2X. tfie stream clock is counted at 
the speed of IX as shown in part (3) of Rgure 31, i.e.. 
at half the speed of stream B due to the txiffer. At point 
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G, the stream clock is reset. Time VPTS2 at which the 
video signal for stream B is output needs to be synchro- 
nized with time VPTS1 in consideration of the delay time 
period Tvd due to. for example. MPEG decoding time 
period. In this case, at point I (t=Tl). when the VPTS 5 
stops rising. AV synchronization control is restarted. By 
checking VPTS2 of stream B and synchronizing VPTS1 
of stream A to VPTS2, synchronization is realized by 
one-system sinple control. VPTS1 can be used addi- 
tionally. 

[01 61 ] Audio data of synchronizing stream B is repro- 
duced and the system clock is switched at point H using 
APTS of stream B as shown in part (4) of Figure 31 . 
Regarding a sub picture signal of stream B. the system 
clock can be switched in a similar manner. 
[0162] By using data of stream B with priority, AV syn- 
chronization is realized witii sinrple control. 
[0163] All the data in streams. A1 and A2 is stored in 
the buffer menrrary, the buffer memory does not over- 
flow. Stream B1 may possibly overflow. However, 
according to the present invention, the synchronization 
control is performed using stream B and the system 
clock is switched to control the signal flow so that 
VPTS2 does not exceed the VPTS threshold level as 
shown in part (6) of Rgure 31. Th^-efore. the buffer 
does not ov^low. 

[0164] According to the present invention, the audio 
signal of stream B is used for audio reproduction. 
Therefore, the buffer anrraunt of audio decoder is 
reduced to 1/2. Furthermore, by the system dock is 
switched at point H (t=Th) as shown in part (4) of Rgure 
31, the audio signal is reproduced smoothly without 
exceeding the APTS threshold level. The sub picture 
information is also reproduced with smooth synchroni- 
zation. Accordingly picture, audio and sub picture (sub- 
tities or the like) signals are synchronized, and picture 
and audio are reproduced seamlessly. The audio signal 
and the si±> picture signals of stream A can be omitted. 
In the embodiment where the audio and sub picture sig- 
nals are put into stream B so that stream B2 is repro- 
duced by an existing reproduction apparatus, and 
reproduction of stream A is controlled by the second 
video signal output control information provision section 
179; a picture with no audio signal is prevented from 
being output By omitting the audio and sub picture data 
of stream A. progressive picture software, for example, 
a 2-hour movie, can be recorded in one two-layer disk 
by the interleave block recording system according to 
the present invention. Such an effect will be descrit>ed. 
In the case of a movie, data for about 2 hours and 15 
minutes can be recorded on a one-layer 4.7 GB DVD. In 
order to perform 2-channel recording of a progressive 
picture without finding a differential, 9.4 GB is required. 
A picture signal requires 4 Mbps, and sub picture and 
audio signals require almost 1 Mbps. When the audio 
signal of 1 Mbps is recorded in one stream, a total of 
only 9 Mbps is sufficient In other words, only 90% of the 
data amount, i.e.. 8.5 GB (90% of 9.4 GB) is sufficient. 



Therefore, a two-layer disk accommodates the data for 
one layer and a progressive signal. 
[0165] The synchronization method of the present 
invention functions as follows. Where an interleave 
block of stream A is recorded first and then an interleave 
block of stream B is recorded on the optical disk, when 
the first data (e.g., stream A) is stored in a track buffer 
and the next data (e.g., stream B) is reproduced, the 
synchronization information of stream B is mainly used. 
Specifically, the system clock is svyntched so that the 
video time stanp of stream B (VPTS2) does not exceed 
the threshold value of VPTS2. In this manner. vkJeo and 
audio signals are reproduced in synchronization with 
each other with no disconnection. Stream A can be read 
from the buffer in synchronization with the time informa- 
tion such as VPTS2 (time stamp of stream B). Thus, the 
control is sinrple. 

[0166] As described above, according to the present 
invention, the first stream is once accumulated in a 
buffer arxi only the second stream is processed with 
synchronization. Thus, the control is accurate and sim- 
ple. Overflow and underf kw can be prevented by setting 
the size of the buffer memory to be 1 ILB or more. 
[0167] An existing DVD reproduction apparatus uses 
a 100 to 300 kB txiffer memories, which is about 1/5 of 
the standard 1 ILB. According to the present invention, 
smooth reproduction is performed with the standard 1 
ILB buffer memory. 1 ILB corresponds to 0.5 to 2 sec- 
onds. Since the wait time period in the case of multiple 
angle reproduction can be only about 1 secorxi, 1 ILB is 
actually considered to correspond to 0.5 to 1 second. In 
order to harxJIe an 8 Mbps stream corresponding to 1 
second, a buffer memory of 1 MB or more is usable in 
tiie reproduction apparatus according to the present 
invention. 

[0168] The synchronization control section 166 in Fig- 
ure 30 can switch the system clock using the synchroni- 
zation data regarding the interleave blocks 12 and 16 of 
tiie second video signal to realize seamless reproduc- 
tion between interleave blocks. During data reproduc- 
tion for irrterleave blocks 12 and 16. the motor rotation 
speed reproduction track is controlled while monitoring 
the buffer amount of stream B. Thus, the memory 
amounts of the track buffers 23a and 23b can be opti- 
mized so as not to overflow. All the data for the inter- 
leave blocks 12 arxJ 16 of stream A is in the track buffer 
23a and is not suitable to optimize the buffer size. When 
audio data of the interleave blocks II arxi 15 is used for 
reproduction, it is required to accumulate the one inter- 
leave block or more of audio data and sub picture data 
in the track buffer 23 (Figure 39) and the audio decoder 
buffer 1 72 (Figure 39) as shown in part (3) of Figure 45 
in order to match the time stamp of the audio data with 
the time stamp of the video output of parts (8) arid (11) 
of Rgure 45. By contrast, when the audio data of the 
interleave blocks 12 and 16 is used, 1/2 ILB data is suffi- 
cient as shown in part (5) of Figure 45. Accordingly, the 
required memory amount of the track buffer 23 (Rgure 
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39) and the audio decoder buffer 172 (Rgure 39) is 
reduced to half. 

[0169] As sfiown in Figure 45. for reproducing data of 
interleave blocks II and 12 including the main signal of a 
progressive signal and data of interleave blocks 15 and s 
16 including the interpolation of the progressive signal, 
the interleave blocks 15 and 16 can be stored in the 
buffer and then the motor rotation can be controlled 
based on the reproduction data regarding the interleave 
blocks 12 and 16. Thus, the menrary amount of the txiffer io 
is reduced. The system clock of the AV synchronization 
control section 1 58 in Figure 30 can be switched based 
on the system clock of the interleave blocks 12 and 16. 
Thus, stafcrfe decoding is realized witiiout causing the 
buffer to overflow. 15 
[0170] The method of skipping tiie first f ieW of a VOB 
off a progressive signal is described with reference to 
Rgure 37. A second practical method is carried out with 
the recording apparatus 99 shown in Figure 22. Among 
an Odd Rrst identifier 199 obtained by interlace trans- 20 
form arxJ an Even Rrst identifier 200, only the Even Rrst 
identifier 200 is transformed by an Even/Odd transform 
section 201 into an Odd Rrst identifier 202 and provided 
to each piece of MPEG data. Thus, all tiie VOBs start 
with an Odd First identifier. 25 
[0171] As shown in Rgure 21 . tiie reproduction appa- 
ratus reproduces the data regarding tiie Odd Rrst iden- 
tifier 199 and tfie data regarding the Odd Rrst identifier 
202 obtained from the Even Rrst identifier. In step 203. 
it is checked whether or not a progressive signal is 30 
reproduced. If yes. in step 204. tiie Odd Rrst identifier of 
the second video signal is transformed into an Even 
Rrst identifier 200a and sent to the int^-lace transform 
section 71 b of the MPEG decoder. If no. the identifier is 
not transformed. The interlace transform section 71b 35 
outputs the field of the frame picture of the second video 
signal first. Thus, an Even First picture is output. The 
syrrthesis section 90 synthesizes the Even Rrst picture 
of the second video signal and the Odd First picture of 
the first video signal and outputs a normal progressive 4o 
picture. By this metfiod, all tiie interleave blocks start 
with an Odd Rrst picture, and thus seamless multiple 
angles are reproduced with no problem by a DVD repro- 
duction apparatus. Since each interleave block is 
restricted to start with an Odd First picture for seamless 45 
multiple angle reproduction, the dummy fiekJ need not 
be inserted. Thus, the recording efficiency is not 
reduced. 

[0172] According to the second method of even/odd 
transform, the first video signal is normally reproduced so 
even witii an existing reproduction apparatus. However, 
when interlace transform is performed in accordance 
with the Odd Rrst identifier of the second video signal 
by tiie existing reproduction apparatus, the odd field and 
the even field are inverted. Thus, a low quality picture 55 
with a lower resolution is output. In order to avoid this, 
when a conventional reproduction apparatus is used, 
information regarding the restriction on the reproduction 
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of the second video signal by tiie DVD format is 
recorded on the optical disk 85 by the second video sig- 
nal output resti^iction information provi^on section 
described with reference to Rgure 40. Thus, tiie second 
video signal is not reproduced by the existing r^roduc- 
tion apparatus, and the situation where the user views 
unpleasant picture is avoided. 

[01 73] With the recording apparatus, an Odd Rrst pic- 
ture (field picture) and a transformed Odd Rrst picture 
(field picture), both of which are field pictures, are com- 
pressed respectively by compression sections 81a and 
81b by variable encoding. When motion detection and 
compensation are performed separately, encoding of a 
picture which is difficult to compress results in separate 
t>lock distortions. When such encoded signals are syn- 
thesized into a progressive signal, the decoded picture 
is deteriorated with noise. In order to avoid this, motion 
detection conpensatbn is performed with an identical 
motion vector by one motion detection/compensation 
section 205 for encoding. Such processing matches the 
block distortion when the two fields are decoded. The 
matched block distortion is less conspicuous. Further- 
more, the load for encoding is reduced. 
[0174] Next, an operation of the AV synchronization 
section 1 58 will be described in detail. 
[0175] The AV synchronization section is one of the 
most important sections of the present invention. 
[0176] Rrst, an operation of a system control section 
in Rgure 5 will be described. The system control section 
21 det^-mines whether or not an optical disk has been 
set (inserted) in the reproduction apparatus. Once the 
optical disk is detected to be set. ttie system control 
section 21 controls a mechanism control section and a 
signal control section to control tiie disk rotation until 
stable reading is performed. When the stat>le reading is 
performed, the optical pickup is moved to read a volume 
information file shown in Rgure 28. 
[0177] The system control section 21 further repro- 
duces a program chain group for a volume menu in 
accordance with volume menu management informa- 
tion in the volume information file shown in Figure 28. 
When the program chain group for the volume menu is 
reproduced, the user can designate data nunrtoers of 
desired audio data and sub picture data. Reproduction 
of the program chain group for the volume menu during 
the reproduction of the data on the optical disk can be 
omitted when it is not necessary for the specific use of 
the multi-media data. 

[0178] The system control section 21 rq^roduces and 
displays a program chain group for a title menu in 
accordance with titie group management information in 
the volume information file. Thus.the system control 
section 21 reads the file management information of the 
video file including the titie selected based on tiie user's 
selection and is directed to the program chain at the 
start of the title. The program chain group is r^Dro- 
duced. 

[0179] Rgure 29 is the flowchart showing a detailed 
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process of reproduction of the program chain group per- 
formed by the system control section 21. As shown in 
Rgure 29, in steps 235a, 235b and 235c. the system 
control section 21 reads corresponding program chain 
Information from the volume Information file or a pro- 
gram chain Information table of the video file. When the 
program chain is not completed in step 235d» the 
processing advances to step 235e. 
[0180] In step 235e, it is determined whether or not 
the currerrt cell and the immediately previous cell should 
be connected seamlessly referring to seamless conr>ec- 
tion instruction information for the cell to be transferred 
next in the program chain information. If yes. the 
processing goes to step 235f for seamless connection 
processing. If no, ordinary connection Is performed. 
[0181] In step 235t the mechanism control section 
and the signal processing section, for example, are con- 
trolled to read DSI packets, so that VOB reproductfon 
end time (VOB„E_PTM) in the DSI packet of the cell 
which has been transferred arxJ VOB reproduction start 
time (VOB_S_PTM) in the DSI packet of the cell to be 
transferred next are read. 

[0182] In step 235h, "VOB reproduction end time 
(VOB__E_PTM) - VOB reproduction start time 
{VOB_S_PTM)" is found. The resultant value is sent to 
the STC offset synthesis section 1 64 in the AV synchro- 
nization control section 158 in Figure 30 as an STC off- 
set value between the current cell and the immediately 
previous cell which has been transferred. 
[0183] Simultaneously, in step 235i. VOB reproduction 
end time (VOB_E_PTM) is transferred to an STC switch 
timing control section 166 as switching time T4 for an 
STC switch 162e. 

[0184] The system control section 21 then instructs 
the mechanism control section to continue reading data 
until the terminal position of the current cell. Thus, the 
data for the current cell is transferred to the track buffer 
23 in step 235j. Upon completion of the transfer, the 
program chain information is read in step 235c. 
[0185] If it is determined a seamless connection is not 
necessary in step 235e. the data is transferred to the 
track buffer 23 until the end of the system stream, and 
then program chain information is read in step 235c. 
[0186] Hereinafter, two exanples of a method for AV 
synchronization control for seamless connection and 
seamless reproduction will be described. In other 
words, the AV synchronization control section 158 
shown in Rgures 26 arxi 39 will be described in detail. 
[0187] Referring to Rgure 39, a system decoder 161 , 
an audio decoder 160. video decoders 69c and 69d, 
and a sub picture decoder 1 59 are ail synchronized to a 
system time clock given by the AV synchronization con- 
trol section in Rgure 30 to process the data in the sys- 
tem stream. 

[0188] Regarding a first method, the AV synchroniza- 
tion control section 158 will be described with reference 
to Rgure 30. 

[0189] In Rgure 30. the AV synchronization control 



section includes STC switches 162a. 162b, 162c and 
162d, an STC 163. an STC offset syntfiesis section 
1 64, an STC setting section 1 65 and an STC switch tim- 
ing control section 166. 

5 [01 901 The STC switches 1 62a, 1 62b. 1 62c, 1 62d and 
162e switch between an output value of the STC 163 
and an output value of the STC offset value synthesis 
section 164 as a reference clod^ to be provided to the 
system decoder 161. the audio decoder 160. the main 

10 video decoder 69c, the sub video decoder 69d and the 
sub picture decoder 159. respectively. 
[0191] The STC 163 is a reference clock of the entire 
MPEG decoder shown in Rgure 39 in ordinary repro- 
duction. 

15 [0192] The STC offset synthesis section 164 contin- 
ues outputting a value obtained by subtracting the STC 
offset value provided by the system control section from 
tiie value of the STC 163. 

[01 93] The STC setting section 1 65 sets an STC initial 
20 value given by the system control section or an STC off- 
set synthesis value given by the STC offset synthesis 
section 164 in the STC 163 at the timing given by tiie 
STC switch timing control section 166. 
[01 94] The STC switch timing control section 1 66 con- 
25 trols tiie STC switches 1 62a tiirough 1 62e and the STC 
setting section 165 t^sed on STC switch timing infor- 
mation given by the system control section, the STC 
163. and the STC offset synthesis value given by ttie 
STC offset synthesis section 164. 
30 [01 95] The STC offset value is an offset value used for 
changing tiie STC value when system stream #1 and 
system stream #2 having different STC initial values are 
continuously reproduced. 

[01 96] The STC offset value is specifically obtained by 
35 subtracting the "VOB reproduction start time 
(VOB_S_PTM)" described in tiie DSI of system stream 
#2 to be reproduced next from the "VOB reproduction 
end time (VOB_E_PTM)" described in tiie DSI of sys- 
tem stream #1 reproduced f irst The information regard- 
40 ing the display of such a value is pre-calculated by 
reading data from the optical disk in Rgure 5 by the sys- 
tem control section 167 when the data is input to tiie 
back buffer 23. 

[0197] The calculated offset value is supplied to the 
45 STC offset synthesis section 1 64 before the last pack of 
system stream #1 is input to the system decoder 161. 
[0198] Except for seamless connection control, tiie 
data decoding processing section 165 in Rgure 5 oper- 
ates as an MPEG decoder The STC offset value given 
50 by the system control section 21 is 0 or an arbitrary 
value. The STC switches 162a through 162e always is 
selected to be connected to the STC 163. 
[0199] With reference to Rgure 38, switching of tiie 
STC switches 162a through 162e in the connection part 
55 of the system control section and an operation of the 
STC 163 when two system streams having non-contin- 
uous STC values, such as system streams #1 and #2. 
are continuously input to the system decoder 1 61 will be 
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described. 

[0200] The SCR, ARTS. VPTS and VDTS of the sys- 
tem streams #1 and #2 to be input will not be described, 
[02011 In the STC 163, an initial STC value corre- 
sponding to system stream #1 which is being repro- s 
duced is set by the STC setting section 165. and the 
value is sequentially counted up in accordance with the 
reproduction. The systOT control section 167 (Rgure 5) 
calculates the STC offset value by the above-described 
method and sets this value in the STC offset synthesis io 
section 1 64 before the last pack of system stream #1 Is 
input to the decoder buffer. The STC offset synthesis 
section 164 continues outputting a value obtained by 
subtracting the STC offset value from the value of the 
STC offset 163. is 
[0202} The STC switch timing control section 166 
obtains time T1 , at which the last pack of system stream 
#1 reproduced first Is input to the decoder buffer, and 
switches the STC switch 162a to the output side of the 
STC offset synthesis section 164 at time T1 (step 20 
168b). 

[0203] Tha-eafter, the STC value referred to by the 
system decoder 1 61 is provided with an output from the 
STC offset synthesis section 164. The transfer timing of 
system stream #2 to the system decoder 161 is deter- 25 
mined by the SCR described in the pack header of sys- 
tem stream #2. 

[0204] Next, the STC switch timing section 166 
obtains time T2, at which the r^roduction of the last 
audio frame of system stream #2 is terminated, and 30 
switches the STC switch 162b to the output side of the 
STC offset synthesis section 164 at time T2 (step 168c) 
at time T2. A method for obtaining time T2 will be 
described later. 

[0205] Thereafter, the STC value referred to by the 35 
audio decoder 160 is provided with an output from the 
STC offset synthesis section 164. The output timing of 
system stream #2 is determined by the ARTS described 
in the audio packet of system stream #2. 
[0206] Next, tfie STC switch timing section 166 40 
obtains time T3 and T3\ at which the decoding of the 
last video frame of the main signal and the sub signal of 
system stream #1 reproduced first is terminated, and 
switches the STC switches 162c and 162d to the output 
side of the STC offset syntiiesis section 164 at time T3 45 
and T3' (step 1 68d). A method for obtaining time T3 will 
be described later. Thereafter, the STC value referred to 
by the video decoders 69c and 69d is provided with an 
output from the STC offset synthesis section 164. The 
video decoding timing of system stream #2 is deter- so 
mined by the VRTS described in tiie video packet of 
system stream #2. Next, the STC switch timing section 
1 66 obtains time T4, at which the reproduction output of 
the last video frame of system stream #1 reproduced 
first is terminated, and switches ttie STC switch 162e to 55 
the output side of the STC offset synthesis section 164 
at time T4 (step 168e). A method for obtaining time T4 
will be described later. 



[0207] Thereafter, the STC value referred to by ttie 
video output switch 169 and the sub picture decoder 
1 59 is provided wntti an output from ttie STC offset syn- 
thesis section 164. The video output timing and stto pic- 
ture output timing of system stream #2 are determined 
by the VRTS and SRTS described in the video packet 
and tiie sub picture packet of system stream #2. 
[0208] When switching of the STC switches 162a 
through 162e is completed, the STC setting section 165 
sets tiie value given by the STC offset synthesis section 
164 in the STC 163 (step 168!) (refenred to as "reload- 
ing of the STC 163) and switches all ttie switches 162a 
tfirough 162e to be connected to the STC 163 (step 
168g). 

[0209] Thereafter, the STC value referred to by tfie 
audio decoder 160, tfie video decoders 69c and 69d, 
the video output switch 169 and the sub picture decoder 
159 is provided witfi an output from tfie STC 163. and 
the operation returns to the ordinary operation. 
[021 0] Now. two means for obtaining time T1 tiirough 
T4 for switching the STC will be described. 
[0211] According to first means, information repre- 
senting time T1 through T4. which can be easily calcu- 
lated when the streams are created, is recorded on the 
disk The system control sectran 21 reads the informa- 
tion and sends the information to the STC switch timing 
control section 166. 

[021 2] Especially as T4, "VOB reproduction end time 
(VOB_E_PTM)- described in the DSI is used as it is. 
[0213] On the disk, the value obtained based on the 
STC value used in system sti-eam #1 reproduced first is 
described, and the STC switch timing control section 
166 switches the STC switches 162a through 162e at 
tiie moment the value of tfie STC 163 becomes time T1 
through T4. 

[021 4] According to second means. t>ased on the tim- 
ing when the leading data of system stream #1 is written 
in the ti-ack buffer 23, the video decoder buffers 1 71 and 
171a, and ttie audio decoder buffer 172. tiie time for 
reading the leading data is obtained. 
[0215] Assuming that tfie track buffer 23 is a ring 
buffer including a writing pointer, a reading pointer and 
a data menwry. the system control section 21 specifi- 
cally reads an address indicated by the writing pointer 
and an address indicated by the reading pointer. Based 
on an address indicated by tfie writing pointer and an 
address indicated by the reading pointer when a target 
pack is written, the system control section 21 detects 
the moment when the pack written immediately before 
is read. 

[0216] When reproduction of system stream #1 is 
completed and reproduction of system stream 4t2 is 
started, the system control section 21 indicates tfie 
leading address of system stream #2 on the optical disk 
for reading. Accordingly, the system control section 21 
learns the moment when the leading data of system 
stream #2 is stored in tfie track buffer 23. Next time T1 
is obtained by marking the address where the leading 
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pack of system stream #2 is wrrrtten and setting the 
moment when reading of the immediately previous pack 
is completed as T1 . 

[021 7] The moment T1 is obtained, the system control 
section 21 informs T1 to the video decoders 69c and 
69d and the audio decoder 160. Thus, the video decod- 
ers 69c and 69d and the audio decoder 160 learn that 
the leading packet of system stream #2 will be trans- 
ferred to the video buffer 171 and the audio buffer 172 
thereafter. 

[0218] Accordingly, the two video decoders 69c and 
69d and the audio decoder 1 60 learn the moment when 
the last packet of system stream #1 is transferred and 
obtain T2 and T3 by managing each decoder fcxiffer in 
the same manner as the buffer management of the track 
buffer 23. 

[0219] In the case where T1 is detected, all the data 
has been read from the video decoder buffer 171 or 
audio decoder txiffer 172 (immediately after the last 
frame of system stream #1 is decoded)* and no data to 
be written has arrived (when the transfer time period 
between packs is enpty), there is no data to be written. 
Thus, address management is impossitrfe. Even in this 
case, the packet of the frame to be decoded next before 
then next decoding timing (decoding timing of the lead- 
ing frame of system stream #2) is transferred without 
fail. Accordingly, the switch timing is learned by setting 
the moment of transfer of the packet as T2 or T3. 
[0220] Regarding T4, as described atXTve, ^'display 
end time of last frame of the video of system stream #1 
(VOB„E„PTM)" can be used as it is. 
[0221 ] Next, a second method for seamless reproduc- 
tion will be described. 

[0222] Figure 31 shows at which timing the system 
stream is reproduced and output after being input to the 
data decoding processing section in Figure 38, passed 
through the decoder buffer and decoded. With refer- 
ence to Figure 31 . a change in each of ARTS and VPTS 
values at the connection point of system streams #1 
and #2 will be described, and a method for AV synchro- 
nization control at the seamless connection area during 
the actual stream processing will be described. 
[0223] Then, with reference to the graph in Rgure 31 . 
a method for performing seamless connection control in 
accordance with the process represented by the flow- 
chart in Figure 43 will be described. 
[0224] The starting timing of the seamless connection 
control is as shown in part (3) of Figure 31 regarding 
SCR. While the SCR value in the graph is increasing, 
system stream #1 is transferred from the track buffer 23 
(Rgure 5) to the data decoding processing section 16 
(Figure 5). Only at point G when the transfer of system 
stream #1 is completed and transfer of system stream 
#2 is started, the SCR value is "0". Accordingly, it is 
found that new system stream #2 is input to the data 
decoding processing section 16 by finding point G at 
which the SCR value is "0". At this point (time Tg), the 
synchronization mechanism control section can turn off 



(release) the AV synchronization mechanism of the 
reproduction output section. 

[0225] It can be detected that the SCR value is "0** 
after the signal read from the optical disk is processed 
5 or written into the track buffer 23. The AV synchroniza- 
tion mechanism can t>e turned off based on the detec- 
tion at this point. 

[0226] In order to determine the timing at which AV 
synchronization mechanism once turned off shouki be 

10 tumed on (started) again, it is necessary to know that 
both the audio output and the video output included in 
system stream #1 have changed to the audio output 
and the video output of new system stream #2 to pre- 
vent inconsistent reproduction by which the audio and 

15 video signals do not match. The moment the audio out- 
put of the previous system stream is changed to the 
audio output, new system stream #2 can be found by 
detecting point H at which the APTS value stops 
increasing. The moment the video output of the pre>n- 

20 ous system stream is changed to the video output, new 
system stream #2 can be fourKi by detecting point I at 
which the VPTS value stops increasing. Accordingly, 
the synchronization mechanism control section can 
restart the AV synchronization at time Ti, t.e., immedi- 

25 ately after finding that point H and point I hoXh appear. 
[0227] When the SCR value is not set in the SCR or 
the APTS value and VPTS value are directiy conpared 
with each other during the period from time Tg to time 
Ti, the period in which the AV synchronization mecha- 

30 nism is off can be further shortened. 

[0228] In order to realize this, t>oth the APTS value of 
the audio output data arvJ the VPTS value of the video 
output data from the data decoding processing section 
16 are monitored, arKi the value which becomes lower 

35 first is detected. At this point, i.e., time Th in Rgure 31. 
the AV syrrchronisation mechanism is turned off. 
[0229] As is apparent, in order to perform the timing 
determination based on whether the APTS arKJ VPTS 
values continue increasing, the APTS and VPTS values 

40 need to be reduced at the point where the system 
streams are connected. In other words, the last APTS 
arxj VPTS values in the system stream need to be 
larger than the maximum initial values of APTS and 
VPTS in the system stream. 

45 [0230] The initial APTS and VPTS values (ATad, ATvd 
in the figure) are determined as follows. 
[0231] The initial APTS and VPTS values are each a 
sum of the time period in which video data or audio data 
is stored in the video txjffer or audio buffer and the reor- 

50 der of the video (in MPEG pictures, the decoding order 
and the display order of the pictures do not necessarily 
match, and display can be delayed by one picture at the 
maximum with respect to the decoding). Accordingly, 
the sum of the time period required for the video txiffer 

55 or audio buffer to become full and the display delay (one 
frame) is the maximum initial value of APTS or VPTS. 
[0232] The system stream can be created so that the 
last APTS and VPTS values in the system stream 
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exceed such values. 

[0233] In this example, the timing for turning on the AV 
synchronization mechanism after the system streams 
are connected has been described to be determined 
teased on whether or not the APTS and VPTS values 5 
Increase. The timing for turning on the AV synchroniza- 
tion mechanism can be determined using the threshold 
value as described below. First, audio arKj video thresh- 
old valu^ shown in parts (4) and (5) of Figure 31 are 
determined by the reproduction apparatus. These val- io 
ues equal to the maximum initial values of APTS and 
VPTS described above. 

[0234] The timing is determined t>ased on whether or 
not the APTS and VPTS values read by the APTS read- 
ing means and VPTS reading means are respectively is 
below the audio threshold value and video threshold 
value. When the APTS and VPTS values are larger than 
the audio and video threshold values, data has not been 
changed to the data of the new system stream. When 
the APTS and VPTS values are equal to or smaller than 20 
the audio and video threshold values, data output of the 
new system stream has been started. Thus, the timing 
for turning on and off the AV synchronization mecha- 
nism may be found. 

[0235] The alx)ve-described on/off control of the AV 2s 
synchronization mechanism provides seamless repro- 
duction which is not disturbed at the connection area of 
the system streams. 

(Calculation of the synthesis section) 30 

[0236] Rgure 98 illustrates in detail the calculation of 
the synthesis section of the reproduction apparatus 
shown in Rgure 21 and the division calculation of the 
recording apparatus shown in Rgure 23. 35 
[0237] Part (a) of Figure 98 illustrates Figure 23 in 
detail. Regafding the 525P or other progressive signal, 
a q^th line data 283 represented by A and a (q+1)th line 
data 284 represented by B are subjected to the calcula- 
tion of {A+B)+2 by a first division calculation section 1 41 40 
of a division calculation section 285. thereby obtaining a 
low frequency component M. which is set as the q*th line 
data of the first stream. In the case of an interlace sig- 
nal, lines 1 , 3 and 5 are created in the pth field. In tiie 
(P+1)tfi field, the (q+1)tii line data. i.e.. lines 2. 4 and 6 45 
are calculated on a line-by-line basis. The resultant 
interlace signal is encoded by a first encoder 82a. 
[0238] A second division calculation section 143 per- 
forms the calculation of A-B. The DVD format and the 
like do not define a negative value, in order to realize so 
conrpatibility with the conventional formats. (A-B)h-2 is 
added to a constant 257 so that a negative value is not 
obtained. In tiie case of 8-bit data. 128 is added as the 
constant 277. As a result of the calculation, an interlace 
signal is created as the q1h line data 280 (S). The inter- ss 
lace signal is encoded by a second encoder 28b and 
recorded on the disk by the M ADM interleave system. 
[0239] Witii reference to part (b) of Figure 98. a calcu- 
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lation of the synthesis section of the reproduction appa- 
ratus shown in Rgure 21 will be described In detail. As 
shown in part (a) of Rgure 98, the data multiplexed by 
the MADM system according to the present invention 
and recorded on the disk 85 is divided into a first stream 
and a second stream, and pirocessed with decoders 88a 
and 88b to obtain two video signals. This signal is an 
interlace signal and a top line first signal (hereinafter, 
referred to as "TP*) in which tiie top line is an odd line. 
In the synthesis section 90, the calculation of (2I^2S- 
constant)^2 is performed by the first calculation section 
250. where M is the qlh line data of the master signal 
and S is the q*th line data of tfie sub signal. As a result. 
(A+B+A-B+^256-256K2=A. The qlh line data (A) is 
otTtained and is output as rlh line data 281 (output pic- 
ture). 

[0240] As shown in part (a) of Figure 98. the constant 
277 is added by tiie second calculation section 143. 
Accordingly, tiie original data is otrtained by subti^cting 
tiie twice tiie value of the value (128) obtained by syn- 
tiiesis. i.e.. 256. Due to the conpatibility. a conventional 
decoder in which negative values are not defined can t>e 
used. 

[0241 ] Then, the calculation of (2M-2S+(2xconstant)) 
is performed by a second calculation section 251. As a 
result. (A+B-A-B-256-256)^2=B. The (q+1)th line data 
284 is obtained and output as (r+1)th line data 282. 
[0242] Thus, two interlace signals are synthesized, 
and a progressive video signal having 480 lines (1st 
through 480th lines) is output. 

[0243] The system shown in Rgures 98, 21 and 23 
has a feature that division and synthesis can be con- 
ducted with only one adder and one subtracter for 8-bit 
data and 1 0-bit data and thus tiie circuit structure is sim- 
plified. Thus, a high resolution picture witii progressive 
and wide video signals are obtained with no significant 
cost increase. 

[0244] Since a negative value is reproduced simply by 
adding tiie constants 278a and 278b to the A-B signal, 
tiie conventional decoders 279 arKi 280 which cannot 
handle negative values are usable. 
[0245] As shown in part (a) of Rgure 98. in bwtii the 
first stream and the second stream, tiie first line of the 
first field is an odd line (Top Line First; TF). According an 
encoder of the DVD format, fields are dropped unless 
tiie streams are Top Line First streams. Since each 
stream is a Top Line First sti-eam according to the sys- 
tem of the present invention, fields are not dropped. 
[0246] Rgure 96 shows an overall operation of the 
reproduction apparatus shown in part (b) of Rgure 98. A 
reproduction signal is divided by a division section 87 in 
units of nGOP into a first stream and a second stream. 
The first and second streams are decoded by first and 
second decoders 88a and 88b into two Top Line First 
(TF) streams. A Top Line First signal 244 and a Bottom 
Line Rrst signal 245 are created by the first calculation 
section 250 and the second calculation section 251. 
Th^. an analog signal such as 525P is output by a DA 
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conversion section 266. 

[0247] In Rgure 96. two field pictures having the same 
time stamp are synthesized In a vertical direction. By 
synthesizing the pictures in a horizontal direction 
according to the present invention, the horizontal reso- 5 
lution can be doubled. Rgures 58. 59 and 60 show a 
recording apparatus, and Figure 20 shows a reproduc- 
tion apparatus including a wide picture synthesis sec- 
tion 173. With reference to Rgures 91 and 92. the 
principle of the division section of the recording appara- 
tus and the principle of the wide picture synthesis sec- 
tion 1 73 of the reproduction apparatus will be described 
in detail. 

[0248] Rgure 91 shows a method for dividing a lumi- 
nance signal and a color signal in the left half. Lximi- 
nance signals YD and Y1 of input pixel signals 287a and 
287b having a 1440 pixels in the horizontal direction are 
subjected to addition and subtraction respectively by a 
first division calculation section 141a and a second divi- 
sion calculation section 141b shown in Rgures 91 and 
92 of the division calculation section 285 in Rgure 98. 
Thus, a luminance signal of (Y0+Y1)/2 of the first 
stream and a luminance signal of (Y0-Y1)/2 of the sec- 
ond stream are generated. The input signal having 1 440 
pixels in the horizontal direction is divided into two video 
signals each having 720 pixels in the horizontal direc- 
tion. The first stream is passed ttirough a horizontal filter 
and thus deprived of a high frequency component. 
AccoitJIngly, even when only the first stream is output on 
the screen by the conventional apparatus, aliasing dis- 
tortion does not occur. Thus, compatibility with the con- 
ventional apparatus is obtained. Rgure 92 shows 
processing of a color signal. An input pixel signal 287a 
and an input pixel signal 287c with one input pixel signal 
interposed therebetween are used. From a signal CbO 
of input pixel signal 287a and a signal Cb2 of the input 
pixel signal 287c, a sum signal (Cb0+Cb2)/2 is obtained 
and set as a division pixel signal 290a of the first 
stream. A difference signal (Ct>0-Cb2)/2 is set as a divi- 
sion pixel signal 291a of the second stream. In a similar 
manner. (Ct0+Cr2)/2 and (Ct0-CrZ)/2 are obtained from 
input pixel signals 287b and 287d. From these signals, 
division pixel signals 290b and 291 b of the first and sec- 
ond streams are obtained. Thus, a high resolution sig- 
nal having 1440 pixel in the horizontal direction is 
divided into two NTSC-grade digital video signals of the 
CC1R601 and SMPTE295M formats. 
[0249] Next, the processing of the synthesis section 
173 of the reproduction apparatus briefly described with 
reference to Figure 20 will be described in detail. In the 
synthesis section 90 in Rgure 91. division pixel signals 
288b and 289b of the first and second streams are 
added together by the first calculation section 250 by 
the calculation of (Y6+Y7)/2+(X-Y+256)/2-128=Y6. 
Thus, the input pixel 287g is obtained. Next, the differ- 
ence calculation of {Y6+Y7)/2-KX6-Y7+256)/2+128=Y7 
is performed. Thus, tiie luminance signal of the input 
pixel 287h is obtained. In this manner, a high resolution 



signal having 1440 pxels in the horizontal direction is 
otrtained from two signals each having 720 pixels in the 
horizontal direction by a sum calculation and a differ- 
ence calculation. 

[0250] Next, syntinesis calculation of color signals will 
be described with reference to Rgure 92, In the case of 
the Or signal, the division pixel signals 290d arKf 291 d 
of the first and second streams are subjected to sum 
calculation by the first calculation section 250 and differ- 
ence calculation by the second calculation section 251 . 
Specifically, the calculations of (Cr4+Cr6)/2+{Cr4- 
Cr6+256)/2- 1 28=Cr4 and (Cr4+Cr6)y2-(Cr4- 
CrS+256)y2+128=Cr6 are performed. Cr4 and Cr6 are 
obtained and assigned to input pixel signals 287f and 
287h. 

[0251] Regarding the Cb signals, similar calculations 
are conducted on the division pixel signals 290c and 
291c. Cr4 arKi Cr6 are obtained and assigned to input 
pixel signals 287e arvi 287g. Thus, the luminance ^g- 
nals and color signals of the input signal are completely 
synthesized to obtain a high resolution signal having 
1440 pixel in the horizontal direction. 
[0252] By the 2X reproduction apparatus, an interiace 
signal having 1440 pixels in the horizontal direction is 
otTtained. By the reproduction apparatus shown in Fig- 
ure 62, 3-2 transform is performed. In the case where a 
24-frames/sec. signal of a movie or the like is recorded, 
the 24-frames/sec. signal is output a plurality of times by 
the frame memory by the 3-2 transform section 174. 
Thus, a 60-frames/sec. progressive video signal is 
obtained. By doubling the horizontal resolution to 1440 
pixels, a wide 525P picture is otrtained. Thus, a 
1440x480P progressive picture is output 
[0253] Thus, by combining the 3-2 transform section 
174 and the wide picture synthesis section 173. a 
144Qx480P high resolution progressive picture is output 
from a 24P picture such as a movie even by the 2X 
reproduction apparatus. When such a picture is repro- 
duced by an existing DVD player, only the sum signal of 
the first stream is reproduced, but horizontal interlace 
interference does not occur since the picture is horizon- 
tally filtered. 

[0254] With reference to Figure 97. an operation of 
reproducing data on an MADM disk will be described. 
On the MADM disk, a 60-frames/sec. progressive pic- 
ture is divided into two frames, i.e.. an odd frame 294 
and an even frame 295. The operation of the division 
section 87 and the decoding section 88 is the same as 
described with reference to Rgure 96 and will not be 
described. In the time direction synthesis section 296. a 
first field 297a and a second field 297b of the first 
stream are synthesized into a first odd frame 294a. A 
first field 298a and a second field 298b of tiie second 
stream are synthesized into a first even frame 295a. 
These frames are synthesized in the time direction in 
the order of the first odd frame 294a. the first even frame 
295a. the first odd frame 294b. and the second even 
frame 295b every 1^0 second. Thus, a 60-frames/sec. 
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(Stream switching prohibiting flag) 

[0277] As a method for preventing a differential signal 
of a high resolution signal from being output in an exist- 
ing apparatus, a method for recording a stream switch- s 
ing prohibiting flag will be described. 
[0278] As shown in Rgure 86, in step 307a. a stream 
switching prohibiting flag 309 is recorded on a disk 1c. 
In step 307b, stream 1 is set as the initial stream value 
in the management information. io 
[0279] \/Vhen the disk 1 c is set in an existing reproduc- 
tion apparatus, in step 307a, management information 
for angle 1. i.e.. stream 1 is read. In step 307f, angle 1 
is reproduced. When an angle switch instruction is 
issued in step 307g, an angle (stream) switching prohib- is 
iting flag is checked in step 307h. In an MADM disk, the 
angle (stream) is not switched since the flag is 
recorded. Accordingly, the output of the differential pic- 
ture is prevented and the conpatibility is maintained. 

20 

(HDTV(1080i) output) 

[0280] A method for creating a 1 080i picture to be out- 
put to an HDTV will be described. In Figure 20, a wide 
525P picture is displayed as shown in the scope screen 25 
178. The output Is transformed into a progressive signal 
having 1050 lines by a line doubler. The progressive sig- 
nal is further transformed into an interlace signal having 
1050 lines by an interlace transform section 175b. That 
is, an Interlace picture 178b having atx>ut 1080 lines is 30 
obtained. Thus, output to the HDTV is realized. 

(High definition audio output) 

[0281] In Figure 20, a high definition audio signal is 35 
reproduced. In the case of linear PCM, a range of 1.5 
Mbps to 4 Mbps is required. In MADM, as shown in Fig- 
ure 88, a basic audio section 312 is recorded in stream 
1 with 380 kt>ps ACS, and a high definition audio section 
313 is in stream 3. An audio recording identifier 314 is 40 
recorded as an MADM identifier. In tiie reproduction 
apparatus in Rgure 20, when an audio recording identi- 
fier 314 is reproduced by an audio recording identifier 
reproduction section 111, an audio signal is separated 
from the stream 2. and a high definition audio signal is 45 
reproduced by an audio decoder 1 60a arxi output as an 
audio signal in the figure. 

[0282] In the case of DVD. one stream has only a max- 
imum of 8 Mbps. When a high definition audio signal 
which can have a maximum 4 Mt>ps is recorded into so 
stream 1 which already has a basic picture, the basic 
picture is restricted to only 4 Mbps and deteriorated in 
terms of quality. Thus, corrpatibility is not maintained. 
According to the present invention, the audio signal is 
accommodated in streams 2, 3 and 4 as the high defini- 55 
tion audio signals 313a, 313b and 313c in Figure 88. In 
this manner, the high definition audio signals can be 
recorded without deteriorating the quality of the basic 



picture. Especially, the data amount of 525P differential 
signal in stream 2 is 1/2 to 1/3 of the basic picture, and 
thus stream 2 still has about 4 Mbps. Even when the dif- 
ferential video signal and the high definition signal are 
recorded in streams 2 and 4 as the high definition audio 
signals 313a and 313b in Rgure 88. the high definition 
video and audio signals can be reproduced by a 2X 
reproduction apparatus without deteriorating the differ- 
ential signal. 

(Comparison method of MADM Identifier) 

[0283] As shown in Figure 4. an MADM disk has an 
MADM identifier in management information such as a 
TXT file. However, the TXT file may possibly have the 
same data as the MADM identifier in error. When the 
non-MADM disk is r^oduced as an MADM disk, mal- 
function occurs and an abnormal picture Is synthesized 
and output In order to avoid such malfunction, authen- 
tification data for conparison is recorded according to 
tiie present invention. 

[0284] As shown In Rgure 1, an autherrtification data 
generation section 315 is provided. The MADM identi- 
fier 10b and Inherent attribute information 316 of tiie 
disk (master disk) such as tiie titie of the disk, disk ID, 
disk capacity, and final address value are calculated by 
authentiflcation data generation calculation section 316. 
Thus. MADM authentification data 318 is generated. 
The MADM autiientification data 318 is recorded on tfie 
optical disk 1 together with the MADM identifier 1 0b and 
the authentification data 318 or progressive/3D 
arrangement information. 

[0285] Then, tiie optical disk 1 is reproduced by tfie 
reproduction apparatus in Rgure 5 and compared by an 
MADM identifier comparison section 26a. 
[0286] The operation will be described in detail with 
reference to Figure 9. The MADM identifier comparison 
section 26a reads the MADM identifier 10b. the MADM 
authentification data 318. and the inherent attribute 
information 316 such as the title of the disk, disk 
number, capacity, and address from the optical disk 1. 
and compares the three types of data by the conpari- 
son calculation section 319. Only when it is determined 
that the data is correct by tiie determination section 320, 
an insti-uction to reproduce tiie MADM disk by the 
MADM reproduction section 321 is sent to the control 
section 21. Thus, tiie two streams are synthesized to 
output a high resolution picture or a 3D picture. VSflien it 
is determined that the data is incorrect by the detern™- 
nation section 320. an instruction to perform ordinary 
reproduction by an ordinary reproduction section 322 
without MADM reproduction is sent 
[0287] In this manner, even when the same data as 
the MADM identifier 10b Is recorded in the TXT file in 
error, the MADM reproduction apparatus performs com- 
parison using tiie comparison data. Accordingly, mal- 
function is prevented. The authentification data and the 
MADM identifier can be one piece of data, or encrypted 
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enlarged as shown in the 2-screen picture 28i in mode 
1 , the first audio signal is used. In an opposite case, the 
second audio signal is output as in the 2-screen picture 
28J. Thus, by changing the ratio of the video signals and 
audio signals of the first and second streams, video and 5 
audio can be matched. Pictures of streams 3 through 6 
can t>e displayed in a divided manner as shown in a 2- 
screen picture 28m. 

[0271 ] As descrtoed above, in the embodiment where 
two streams are simultaneously reproduced to output 10 
two video signals, and the synthesis of video signals 
and synthesis of audio signals are performed using the 
2-screen synthesis sections 28 and 28b and the audio 
mixer 28f, two streams, for example, pictures taken by 
two cameras can be viewed simultaneously. is 

(Alteration of the filter) 

[0272] According to the present invention, a video sig- 
nal is divided into a low frequency component and a 20 
high frequency conrqx)nent by a picture division section 
141a shown in, for exanrple, Rgure 22. The division fil- 
ter can be represerrted as in Rgure 46. In Rgure 22, 
division calculation of the first stream is corKfucted by 
calculation parameters of ml=0. m2=1/2. m3=1^. and 25 
m4=0. Division calculation of the second stream is con- 
ducted by calculation parameters of m1=0, m2=1/2. 
m3=-1/2, and m4=0. Under these conditions, a 525P 
progressive signal is divided into a low frequency com- 
ponent and a high frequency conponent at the vertical 30 
resolution of 250. 

[0273] The dividing frequency of the border can be 
altered by changing the calculation parameters of m1 . 
m2, m3 and m4. As shown in Figure 50, the dividing fre- 
quency can be changed from 200, to 250 arxl to 300, 35 
and each filter identifier 144 can be recorded on the 
optical disk. Thus, the filter identifier 144 is detected by 
a filter identifier reproduction section 305 of the repro- 
duction apparatus in Rgure 96 during data reproduc- 
tion, and the set values of calculation parameters of n1 40 
n2. n3 and n4 of the calculation section 212a are 
changed by a calculation parameter output section 306 
in accordance with the filter identifier in Rgure 50. The 
calculation section 212a of the synthesis section 90 per- 
forms calculation by the set values and processes verti- 45 
cal lines n-1, n, n+1 and n+2 based on the calculation 
parameters 196 of n1, n2, n3 and n4. ther^y obtaining 
the n-line signal. This processing can be actually per- 
formed in the first calculation section 250 and the sec- 
ond calculation section 251 . so 
[0274] By changing the dividing frequency of the pic- 
ture division filter, the distritxjtion of the data amount 
between the first and second streams can be changed. 
In the case of the DVD format tiie first and second 
sfreams each have a maximum capacity of 8 Mpbs, ss 
When the dividirrg frequency is fixed, a picture having a 
high ratio of high frequency component causes the sec- 
ond stream data to overflow, resulting in collapse of 



MPEG encoding signal in the high frequency range. A 
picture having a high ratio of low frequency component 
causes the first stream data to overflow, resulting in col- 
lapse of encoding to significantly deteriorating the pic- 
ture quality. In the case where the dividing frequency is 
variable, when the high frequency conponent is exces- 
sive, the dividing frequency in Rgure 50 can be 
increased to 300. Thus, the second sfream data amount 
is reduced and the first stream data amount is 
increased. Thus, the disfribution of the data is opti- 
mized, so that the collapse of encoding is avoided. 
[0275] When the low frequency component is exces- 
sive, the dividing frequency can be decreased to 200. 
Thus, the first stream data amount is reduced, which 
avoids collapse. Collapse is usually avoided this way, 
and the variable dividing frequency is effective. By 
changing the border of the division filter in accordance 
with the condition of the picture, collapse of encoding of 
one of the streams can be avoided. Accordingly, a satis- 
factory video signal is obtained. In other words, the 
overflow of the first or second stream is avoided by 
changing the division point, so that recording and repro- 
duction are performed witii the data amount being dis- 
fributed in a satisfactory manner. 

(Scanning line transform) 

[0276] An operation of a scanning line fransform sec- 
tion 29a described with reference to Rgure 5 will be 
specifically described. An MADM disk includes both an 
area having a high resolution signal such as a progres- 
sive signal and an area having a standard resolution 
signal such as an NTSC signal. The two streams are 
reproduced simultaneously and irxiependently. The out- 
put is changed from progressive to NTSC or from NTSC 
to progressive. When a signal is output from the output 
section 29b with no processing at the point of change, 
tiie scanning frequency is changed from 31.5 kHz to 
15.7 kHz. Therefore, the deflection frequency of the TV 
29c is switched, thus disturbing the picture for a few 
seconds. Even in a TV having a built-in line doubler, tiie 
picture is disturbed when a progressive picture is 
switched to an NTSC picture. According to the present 
invention, this is avoided by automatically switching the 
progressive signal by the output section 29b. In more 
detail, the NTSC picture of the first stream is scanned at 
2X by the scanning fransform section 29a using an 
MADM disk identifier 1 0h recorded on the MADM disk 1 
or the progressive signal is output as it is. Since the high 
resolution area for reproducing two sfreams is switched 
to an ordinary resolution area for reproducing one 
stream, the output signal is immediately changed. 
Therefore, a progressive signal is continuously input to 
the TV 29c. This system eliminates disturt^ance from 
the TV picture. 
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streams 1 and 3 to maintain the continuous reproduc- 
tion mode of stream 1. Alternatively, stream 1 is 
switched to stream 3, and reproduction is conducted 
continuously in terms of time but while skipping from 
data to data. As shown in step 303g, an ordinary NTSG 
picture of strean^ 1 and 3 is reproduced, but an 
unpleasant, unnecessary picture of streams 2 and 4 is 
not output. Thus, complete conpatibility is realized. 
[0262] A process for simultaneously reproducing two 
streams out of streams 1. 2. 3 and 4 by the MADM 
reproduction apparatus will be described with reference 
to Figures 94 and 95. As shown by second reproduction 
information 301. 301a, 301b, 301c and 301 d in part (b) 
of Figure 95, the interleave unit 84a has leading 
address information of the interleave unit 84e. which is 
the next time irribrmation of streams 1 , 2, 3 and 4. Since 
a physical addresses of a sector of an arbitrary inter- 
leave unit 84e, 841. 84g or 84h is found, a track jump is 
easily conducted. The reason is that the MADM repro- 
duction apparatus reproduces the second reproduction 
information identifier 302, learns the existence of the 
second reproduction information, and utilizes the sec- 
ond reproduction information 301 . 
[0263] Thus, simultaneous reproduction of streams 1 
and 2 or streams 3 and 4 is performed, and reproduc- 
tion of a 3D or high resolution signal from an MADM disk 
is realized. The second reproduction information identi- 
fier 302 only needs to distinguish a conventional disk 
from an MADM disK and can be even 1-t>it data. An 
MADM tdentifter indicating the existence of a high reso- 
lution signal or 3D signal can be used. 
[0264] This operation will be described with reference 
to the flowchart in Figure 94. In step 304a, an MADM 
disk is reproduced. In step 304b, it is checked whether 
there is a second reproduction information identifier 302 
or not. or whether there is an MADM high resolution/3 D 
identifier or not. If no, the disk is determined to t»e a con- 
ventional disk and the processing goes to step 304h. tf 
yes, the processing goes to step 304c to check for the 
identifier of the interleave unit 84. If there is an identifier 
showing the existence of the second reproduction infor- 
mation, or if there is a seamless identifier in the case of 
the DVD. the seamless identifier is interpreted as a non- 
seamless identifier. The second reproduction informa- 
tion, which is not actually valid, is regarded as being 
valid in step 304d. In step 304e. link information on 
steps 1, 2, 3 and 4 is extracted from the second repro- 
duction iriformation. 

[0265] In step 3041, first reproduction informalion. or a 
main stream which is switchable from the DSI table in 
the case of the DVD. is detected. In the exanple shown 
in Rgure 95. streams 1 and 3 are found to be main 
streams. The first reproduction information includes 
main stream information, and the secorxi reproduction 
information includes main and sub stream information. 
Accordingly, the main and sub streams can be distin- 
guished based on the first and second reproduction 
information. In the case of Figure 95. the numl>er of 



stream groups (angles) is found to be 2 by checking the 
secofKl reproduction information. 
[0266] When an instruction to switch the stream 
(angles) is issued in step 304g, a switch from sti-eam 1 

5 to stream 3 is corxlucted in step 304m. For this, simul- 
taneous reproduction mode (A) for streams 1 and 2 
using pointer information on streams 1 and 2 of the sec- 
orxj reproduction information is switched to simultane- 
ous reproduction mode (B) for streams 3 and 4. In other 

10 words, stepping access to the interleave units 84a, 84b, 
84e and 84f is switched to stepping access to the inter- 
leave units 84c, 84d and 84g. Thus, two-stream groups 
can be switched in units of two streams. 
[0267] Returning to step 304h, when a seamless iden- 

15 tifier indicating the second reproduction information is 
invalid is recorded on the disk, tiie conventional appara- 
tus regards the second reproduction information (PCI) 
as being invalid in step 304j. Thus, only streams 1 and 
3 are reproduced using only the first reproduction infor- 

20 mation (DSI) in step 304k. 

[0268] As described above, by detecting eitiier tiie 
conventional or the MADM identifier, the second repro- 
duction information which is not valid in accordance with 
the conventional rule is regarded as being valid. Accord- 

25 ingly, a meaningless or unpleasant picture is not output 
from the MADM disk e^en by a conventional apparatus. 
Thus, the compatibility is improved. 

(2-screen simultaneous reproduction) 

30 

[0269] With reference to Rgure 90, an operation of the 
2-screen synthesis section 28 described with reference 
to Figure 5 will be described in detail. Although n pieces 
of screens are used, the representation of 2-screen is 

35 used in this specification. To the n-screen synthesis 
section 28b in Rgure 90, a first picture (A) and a second 
picture (B) of the first stream, a first sub picture and a 
second sub picture are input. In a simple structure, a 
line memory 28c is included. In this case, line-synthesis 

40 of the first picture (A) 28p and the second picture (B) 
28q results in a picture of nnode 1 L having two screens 
side by side is obtained. Audio signals (A) and (B) of the 
first and second streams are synthesized by an audio 
mixer 28f. In the case of mode 1 L, only the audio signal 

45 (A) is output. In mode 2L. a first sub picture of the first 
stream is synthesized on the screen. Only one sub pic- 
ture 28r such as sut>tities is selected and displayed by 
the n-screen synthesis section 28b. This has an effect 
of enlarging the display. In mode 2U a second audio sig- 

50 nal B is output after mixing to tiie speaker to the right of 
the screen. Thus, the second audio signal 28s of the 
second picture B can be listened to at a low volume. 
[0270] As a higher structure, a frame memory 28d can 
be used. In this case, zooming of two screens is real- 

55 ized. A zoom signal generation section 28e which has 
received a zoom instruction signal 28p sends a ratio 
change signal to the n-screen synthesis section 28b 
and the audio mixer 28f. When the first picture (A) is 
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progressive picture is reproduced. By the existing 1X 
reproduction apparatus, only the first stream is repro- 
duced; i.e.. a 525P interlace signal Is rq>roduced and 
the compatibility is realized. However, the motion is 
slightly unnatural since the picture is a 30-frames/sec. 5 
picture. This system is an MADM system for recording 
two 30-frames/sec. streams and has the effect of a high 
encoding efficiency of the MPEG encoder due to the 
progressive picture. 

10 

(Optimization of buffer amount) 

[0255] Regarding the total capacity of the track buffer 
circuit 23 in Rgure 5. it was described that data for at 
least one interleave block needs to be accommodated is 
in the track buffer circuit 23 in order to reproduce two 
streams simultaneously as shown in Rgure 45. With ref- 
erence to Rgure 87. a buffer amount required for the 
MADM system reproduction according to the present 
invention will be calculated. As the capacity of one inter- 20 
leave block, the values in Rgure 87 are obtained by cal- 
culation. Rgure 87 shows interleave unit lengths 
required for 5000-sector and 10000-sector track junrps 
with respect to each of transfer rates. The maximum 
transfer rate is 8 Mbps, and the maximum jump length is 25 
10000 sectors. With the minimum of 551 sectors as the 
interleave unit length, a stable track jump is realized for 
switching to an interleave unit of another stream even by 
a IX drive. In actuality, a drive of more than 1 X is used, 
and thus the length of 551 sectors is not necessary. In 30 
consideration of the worst case, the disk manufacturers 
record an interleave unit of 551 or more sectors for an 8 
Mbps stream. Accordingly, a buffer memory for one 
interleave unit is required by the MADM system accord- 
ing to the present invention as shown in Rgure 45. Sta- 35 
ble simultaneous reproduction of two streams is 
realized by setting a buffer memory of 551 sectors or 
more and 1 1 02 bytes or more. 

(Switching between two pieces of reproduction informa- 40 
tion) 

[0256] Rgures 93. 94 and 95 illustrate a system for 
maintaining the conpatibility by reproducing the same 
disk by a conventional apparatus and an apparatus 45 
according to the present invention. 
[0257] Rgure 95 shows an operation of the conven- 
tional apparatus for r^roducing an MADM system disk 
according to the present invention in part (a), and shows 
an operation of an MADM system apparatus for repro- so 
ducing the MADM system disk in part (b). 
[0258] An optical disk 1 a includes a plurality of (four in 
the figure) streams recorded in a divided manner. 
Accordingly, four interleave units 84a, 84b, 84c and 84d 
having the same information on an n time period are ss 
recorded on the optical disk la in an order. Also on the 
optical disk la, a second reproduction information iden- 
tifier 302 is recorded. The second reproduction informa- 
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tion identifier 301 indicates that first reproduction 
information 300 for reproducing streams 1 and 3 and 
second reproduction information 301 for reproducing 
streams 2 and 4 are recorded on the optical disk la. 
[0259] As shown in part (c) of Rgure 95. the first 
reproduction information 300. 300a and 300c has only 
leading address information regarding the interleave 
blocks 84a and 84c corresponding to streams 1 and 3, 
i.e.. a pointer. The second reproduction information 
identifier 302 is not reproduced by an existing reproduc- 
tion apparatus which does not consider reproduction of 
MADM data. Thus, the second reproduction information 
identifier 301 cannot be read or utilized effectively. 
Accordingly, the corrventional apparatus operates as if 
only streams 1 and 3 are recorded. Streams 2 and 4 are 
not reproduced at all. A conventional reproduction 
apparati^ reproduces, for example, only the left-eye 
information from an optical disk having a 3D signal 
recorded in an MADM system. When 3D display is not 
conducted, display of a meaningless right-eye picture is 
prevented. 

[0260] In the case of an optical disk having a high def- 
inition picture recorded in an MADM system, streams 1 
and 3 have basic components, for example, NTSC. 
Streams 2 and 4 have a differential signal, i.e., colorless 
line-drawing. Since streams 2 and 4 are not reproduced 
by the conventional apparatus, it Is prevented tfiat the 
user views such an unpleasant picture. When such an 
MADM disk is reproduced k>y a conventional reproduc- 
tion apparatus, a normal picture of streams 1 and 3 is 
reproduced but an at>normal picture of streams 2 and 4 
is not reproduced. Accordingly, complete conpatibiiity is 
realized. This operation will be described with a flow- 
chart. As shown in Rgure 93, in step 303a, an MADM 
disk having m streams is reproduced. First reproduction 
information 300a has pointer irrformation on streams 1 
and 3, i.e., the leading address of the interleave unit 84e 
to be jumped to next. The address information is used to 
conduct a track jump over a plurality of tracks as shown 
in Rgure 3 to access the leading address of the inter- 
leave block 84e. The interleave block 84e is the first 
block among the subsequent blocks in stream 1 having 
time information. Thus, data in stream 1 is continuously 
reproduced. 

[0261] When an instruction to switch the stream is 
issued in step 303b. whether there is an identifier show- 
ing the existence of a PCI tat>le is present or not is 
checked in step 303c. A DVD has a PCI identifier (non- 
seamless) showing the existence of the second repro- 
duction information 301 . An MADM disk fias a DSI iden- 
tifier (seamless) sfx>wing the existence of the first 
reproduction information is recorded in lieu of the PCI 
identifier. When the disk is an MADM disK the process- 
ing advances to step 303d to utilize the DSI table having 
the first reproductions information. The first reproduc- 
tion information has pointer information on only streams 
1 and 3 in step 303e. Therefore, in step 303f, a track 
jump is conducted based on the pointer information on 
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data of the MADM identifier and the disk attribution 
inforniation can be recorded. 

[0288] So far, applications of a system for reproducing 
and synthesiztng a plurality of streams, i.e., an MADM 
system according to the present invention have been s 
described. Hereinafter. MADM synchronization systems 
will be described. 

(Example 2) 

10 

[0289] The MADM system according to the present 
invention simultaneously reproduction of a plurality of 
streams. Synchronization methods are inrportant. In the 
second through eighth exanrples, various methods of 
synchronization will be described. The MADM system Is is 
also applicable to recording and r^roduction of high 
resolution pictures such as 3D or 525P pictures, which 
will not be described below. 

[0290] As an example, in the second exanple. an 
operation of a reproduction apparatus for reading data 20 
from an optical disk having three compression vkieo 
signals to be reproduced simultaneously and extending 
and reproducing the three connpression video signals 
simultaneously will be described. 

[0291 ] Rgure 66 shows a data structure of the optical 25 
disk used in the optical disk reproduction apparatus in 
the second example. 

[0292] Video signals A. B and C are MPEG-com- 
pressed to obtain compression video streams A, B and 

C. 30 

[0293] The conpression video streams A B and C are 
each packeted in units of 2 kB into packets. A packet 
header of each packet includes a stream ID for indicat- 
ing which one of the compression video streams A 
through C is stored. When the packet stores a leading 35 
part of the video frame, the packet header also includes 
VPTS (video presentation time stamp) as video repro- 
duction time information indicating the time to repro- 
duce the frame. In the second example, an NTSC signal 
is used as the picture signal, and the video frame cyde 40 
is afcxDut 33 msec. 

[0294] On the optical disk, video packets created in 
the above-described manner are grouped into, for 
example, compression video signals A-1, B-1 and C-1 
each including an appropriate number of packets based 45 
on the data stored, and multiplexed- 
[0295] Figure 64 is a block diagram of the optical disk 
reproduction apparatus in the second exanple. 
[0296] In Figure 64. the optical disk reproduction 
apparatus includes an optical disk 501 described above, so 
an optical pickup 502 for reading data from the optical 
disk 501, signal processing means for performing a 
series of signal processing such as binarization, 
demodulation, and error correction to the signal read by 
the optical pickup 502. a buffer memory 504 for tempo- ss 
rarily storing the data output from the signal processing 
means 503. division means 505 for dividing the data 
read from the buffer memory 504 into conpression 



video signals, and reference time signal generation 
means 506 for generating a reference time signal 506 
including a counter (not shown) for counting 90 kHz 
docks. Reference numerals 510, 520 arKi 530 repre- 
sent buffer memories for temporarily storing the com- 
pression video signals divided by the division means 
505. Reference numerals 511. 521 and 531 represent 
video decoders for exterxling and r^odudng the com- 
pression video signals. Reference numerals 512, 522 
and 532 represent monitors for displaying tiie video sig- 
nals. 

[0297] Rgure 65 shows the structure of each of the 
video decoders 51 1 , 521 and 531 . 
[0298] As showvn in Rgure 65, the video decoder 
includes VPTS detection means 601 for detecting a 
VPTS stored in the packet header of the video packet, 
video extension means 602 for MPEG-extending the 
compression video stream, and video reproduction tim- 
ing control section 603 for comparing the reference time 
signal and the VPTS and skipping or repeating the 
video reproduction on a frame-by-frame t>asis when the 
comparison result exceeds the threshold value. 
[0299] The optical disk reproduction apparatus shown 
in Rgure 64 operates in tiie following manner. 
[0300] The optical pickup is focus-controlled or track- 
ing-controlled by servo means (not shown) to read a 
signal from the optical disk 501 and outputs the signal to 
the signal processing means 503, The signal process- 
ing means 503 objects the signal to a series of 
processings including binarization, demodulation, error 
correction and the like. Then, the signal processing 
means 503 stores the resultant signal in the buffer 
memory 504 as digital data. 

[0301 ] The kxjffer memory 504 functions so that, even 
when tiie data supply from tiie optical disk 501 is tempo- 
rarily stopped by, e.g.. wait state, data supply to the sub- 
sequent-stage sections is not stopped. 
[0302] The data read from tiie buffer memory 504 is 
divided into compression video signals A through C by 
the division means 505 and output. The division means 
kientifies which of the compression video signals A 
through C is stored in each packet witii the packet ID in 
tiie packet header of the packeted data, and determines 
tiie destination based on the identification result. 
[0303] The divided compression video signals are 
respectively stored in buffer memories 51 0 through 530. 
[0304] The tHjffer memories 510 tiirough 530 act to 
continuously supply data to the video decoders 511 
tiirough 531 . 

[0305] The vkleo decoders 51 1 through 531 read data 
from the buffer memories 510 through 530 respectively, 
extend the compression signals, and output the signals 
as video signals to the monitors 512 through 532 
respectively. 

[0306] With reference to Figure 65. an operation of the 
video decoders 51 1 through 531 will be described. 
[0307] The compression video signal read from the 
buffer memory is input to the VPTS detection means 
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601 and the video extension means 602. 
[0308] The video extension means 602 MPEG- 
extends the conpression video stream and outputs the 
video signal. 

[0309] The VPTS detection means 601 detects the s 
VPTS of the packet header. 

[0310] The video reproduction timing control means 
603 receives the video signal output from the video 
extension means 602, a reference time signal and the 
VPTS output from the VPTS detection means 601 . arxJ io 
compares the reference time signal and the VPTS. 
When the difference between the two exceeds the 
threshold value, the video reproduction timing is control- 
led so that the difference between the VPTS arKl the ref- 
erence time signal is equal to or less than the threshold is 
value. 

[031 1 ] In the second example. 33 msec is used as the 
threshold value. The video reproduction timing control 
means 603 performs the following. 

20 

(reference time signal-VPTS)>33 msec.:1 frame is 
skipped. 

(reference time signal-VPTS)<-33 msec.il frame is 
repeated. 

25 

[0312] In the second exanple. due to the precision 
error of the crystal oscillator used in the reference time 
signal generation means 506 and the video decoders 
511 through 531. the video decoders 511 and 531 are 
slower and the video decoder 521 is faster in terms of 30 
extension and reproduction with respect to the refer- 
ence time signal. Unless reproduction timing is cor- 
rected, the reproduced video signals are out of 
synchronization. 

[031 3] Rgure 67 is a timing diagram of video repro- 35 
duction in the second example. Part (a) of Rgure 67 
shows the reference time signal with respect to repro- 
duction time t. Part (b) shows the VPTS#A. which is a 
VPTS of the compression video signal A to be extended 
by the video decoder 51 1 , part (c) shows the VPTS#B, 4o 
which is a VPTS of the compression video signal B to be 
extended by tiie video decoder 521 . and part (d) shows 
the VPTS#C, which is a VPTS of the compression video 
signal C to be exterxJed by the video decoder 531 . 
[0314] The video decoder 511 continues extension 45 
and reproduction of the conpression video signal A, 
and the difference between the VPTS#A and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T1 . Accordingly, the video reproduction timing 
control means of the video decoder 511 skips one so 
frame, which is originally to be reproduced, to correct 
the reproduction timing so that the difference between 
the VPTS#A and the reference time signal is equal to or 
less than the threshold value. 

[0315] The video decoder 521 continues extension ss 
and r^roduction of the compression video signal B. 
and the difference between the VPTS#B and the refer- 
ence time signal exceeds -33 msec, as the threshold 



value at T2. Accordingly, tiie video reproduction timing 
control means of the video decoder 521 repH-oduces one 
frame in repetition, which has been already reproduced, 
to correct the reproduction timing so that tiie difference 
between the VPTS#B and the reference time signal is 
equal to or less than the threshold value. 
[0316] Similarly, the video decoder 531 continues 
extension and reproduction of the compression video 
signal C, and the difference between the VPTS#C and 
the reference time signal exceeds 33 msec, as the 
tiireshold value at T3. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 
skips one frame, which is originally to be reproduced, to 
correct the reproduction timing so that the difference 
between the VPTS#C and the reference time signal is 
equal to or less than the threshold value. 
[0317] As described above, in the second exanple. 
when the difference between the reference time signal 
and the VPTS detected by each video decoder exceeds 
the threshold value, the video reproduction timing con- 
trol means of each video decoder performs correction 
so that difference between the reference time signal and 
the VPTS does not exceed the threshold value. In this 
manner, the pictures reproduced by video decoders can 
be synchronized with one another. 

(Example 3) 

[0318] The tiiird example relates to a reproduction 
apparatus for correcting a reference time signal using 
audio reproduction time information indicating the time 
to reproduce the audio signal and synchronizes a plural- 
ity of video signals based on the reference time signal. 
[031 9] Rgure 70 shows a data structure of the optical 
disk used in the optical disk reproduction apparatus in 
the third example. The optical disk includes compres- 
sion audio data in addition to the data included in the 
optical disk used in the second exanple. 
[0320] An audio signal is audio-framed in units of 32 
msec, for conpression to ot>tain a compression audio 
stream. The audio stream is packeted in units of 2 kB 
into audio packets and recorded on the optical disk. A 
packet header of each audio packet includes a stream 
ID for indicating that the stored data is a conpression 
audio stream. When the packet stores a leading part of 
the audio frame, the packet header also includes APTS 
(audio presentation time stanp) as audio reproduction 
time information indicating the time to reproduce the 
frame. 

[0321] Rgure 68 is a block diagram of the reproduc- 
tion apparatus in the third example. 
[0322] Elements 501 through 532 are the same as 
those shown in Rgure 64 in the second example. 
[0323] Reference numeral 504 represents a buffer 
memory for terrporarily storing the conpression audio 
signal. Reference numeral 541 represents audio exten- 
sion means for exterxJing the compression audio signal. 
Reference numeral 542 represents a speaker for repro- 
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ducing the extended audio signal. 

[0324] Figure 69 shows a structure of the audio 

decoder 541, The audio decoder 541 includes APTS 

detection means 701 for detecting an APTS stored in a 

packet header of the audio packet and audio extension 

means 702 for extending the corrpression audio 

stream. 

[0325] An operation of the optical disk reproduction 
apparatus shown in Rgure 68 for reproducing the opti- 
cal disk shown in Rgure 70 will be descrit>ed. 
[0326] The operation until the signal is input to the 
division means 505 is similar to that with the optical disk 
reproduction apparatus in the second example. 
[0327] The data read from the txjffer memory 504 is 
divided into compression video signals A through C and 
a compression audio signal by the division means 505 
and output. The division means 505 iderrtifies which of 
the compression video signals A through C and the 
compression audio signal is stored in each packet with 
the packet ID in the packet header of the packeted data, 
and determines the destination based on the identifica- 
tion result. 

[0328] The divided compression video signals and 
conpression audio signal are respectively stored in 
buffer memories 51 0 through 540. 
[0329] The video decoders 51 1 through 531 read data 
from the buffer memories 510 through 530 respectively, 
exterKi the compression video signals, and output the 
signals as video signals to the monitors 512 through 
532 respectively. The audio decoder 541 reads data 
from the txjffer memory 540. extends the compression 
audio signal, and outputs the signal as an audio signal 
through the speaker 542. 

[0330] The operations of the video decoders 511 
through 531 for extending the compression video sig- 
nals and for correcting tiie synchronization when the dif- 
ference between the reference time signal and the 
VPTS exceeds the threshold value are the same as in 
the second example. 

[0331] The compression audio signal read from the 
Ixiffer memory 540 is input to the audio decoder 541. 
APTS detection means 701 detects an APTS and out- 
puts. Audio extension means 702 extends the compres- 
sion audio stream and outputs the audio signal. 
[0332] The VPTS signal output from the audio 
decoder 541 Is input to the reference time signal gener- 
ation means 506, and the reference time signal is cor- 
rected by the APTS. 

[0333] In tiie tfiird example, due to the precision error 
of the crystal oscillator used in tiie reference time signal 
generation means 506. the video decoders 51 1 through 
531 and the audio decoder 541 . the reference time sig- 
nal is faster in terms of extension and reproduction with 
respect to the audio decoder 541. The video decoder 
511 is slower and tiie video decoder 521 is faster in 
terms of extension and reproduction with respect to the 
reference time signal. Unless reproduction timing is cor- 
rected, the reproduced video signals and audio signal 



are out of synchronization. 

[0334] Rgure 71 is a timing diagram of audio repro- 
duction in tfie third example. Part (a) of Rgure 71 shows 
tiie APTS with respect to reproduction time t. Part (b) 

5 shows the reference time signal. Part (c) shows the 
VPTS#A. at which the compression video signal A to be 
extended by the video decoder 51 1 is to be reproduced, 
and part (d) shows the VPTS#B, at which the compres- 
sion video signal B to be extended by tiie video decoder 

10 521 is be r^roduced. 

[0335] Rgure 71 does not show the VPTS#C, at which 
tiie conpression vkieo signal C to be extended by the 
video decoder 531 , but tiie diagram Is almost the same 
as in Rgure 67 regarding tiie second example. 

IS [0336] The reference time signal generation means 
506 is conrected using the APTS at time when the APTS 
shows ta1 and ta2. and tiie reference! time signal is 
reset as tal and ta2 at the respective time. 
[0337] Tlie video decoder 511 continues extension 

20 and reproduction of the compression video signal A, 
and the difference between tiie VPTS#A and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T4. Accordingly, the video reproduction timing 
control means of the video decoder 51 1 skips one frame 

25 which is originally to be reproduced to correct the r^ro- 
duction timing so tiiat the difference between ttie 
VPTS#A and the reference time signal is equal to or 
less than the threshold value. 

[0338] The video decoder 521 continues extension 
30 and reproduction of the conpression video signal B. 
and the difference between the VPTS#B and tiie refer- 
ence time signal exceeds -33 msec, as tiie tiireshold 
value at T5 and T6. Accordingly, the video reproduction 
timing control means of the video decoder 521 repre- 
ss duces one frame in repetition which has been already 
reproduced to correct the reproduction timing so that 
the difference between the VPTS#B and the reference 
time signal is equal to or less tfian tiie tiireshold value. 
[0339] As described above, in tiie tfiird example, when 
40 the difference between the reference time signal and 
tiie VPTS detected by each video decoder exceeds tiie 
threshold value, the video reproduction timing control 
means of each video decoder performs correction so 
that difference between the reference time signal and 
45 the VPTS does not exceed the threshold value. In this 
manner, the pictures reproduced by video decoders can 
be synchronized witii one another. 
[0340] Regarding the difference between the refer- 
ence time signal and the APTS, the APTS is not cor- 
50 rected using the reference time signal but the reference 
time signal is corrected using the APTS. Accordingly, 
audio and vkieo signals are synchronized with no 
unnaturalness in the audio output. 



[0341] The fourth exanple relates to a reproduction 
apparatus for correcting the reference time signal using 
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a VPTS detected by one video decoder and synchroniz- 
ing a plurality of video signals based on the reference 
time signal. 

[0342] Figure 72 is a block diagram of an optical disk 
reproduction apparatus in the fourth exanriple. 
[0343] Elements 501 through 532 are the same as 
those in the second example. Reference numeral 551 
represents a video decoder used in the fourth example. 
[0344] The video decoder 551 has a function of out- 
putting the detected VPTS. Figure 73 shows a structure 
of the video decoder 551 . 

[0345] The video decoder 551 includes VPTS detec- 
tion means 801 for detecting a VPTS indicating the 
reproduction time of the video signal multiplexed as the 
compression video signal and video extension means 
802 for extending the compression video stream. 
[0346] In the fourth example, due to the precision error 
of the crystal oscillator used in the reference time signal 
generation means 506 and the video decoders 521 . 531 
and 551. the reference time signal is faster in terms of 
extension and reproduction with respect to the video 
decoder 551 . The video decoder 521 is slower and the 
video decoder 531 is faster in terrr» of extension and 
reproduction with respect to the reference time signal. 
Unless reproduction timing is corrected, the reproduced 
video signals are out of synchronization. 
[0347] Rgure 74 is a timing diagram of video output in 
the fburtii example. Part (a) of Rgure 74 shows the 
VPTS#A detected by the video decoder 511 with 
respect to reproduction time t. Part (b) shows the refer- 
ence time signal. Part (c) shows VPTS#B, at which the 
corrpression video signal B to be extended by the video 
decoder 521 is to be reproduced, and part (d) shows the 
VPTS#C. at which the compression video signal C to be 
extended by the video decoder 531 is to be reproduced. 
[0348] The reference time signal generation means 
506 is corrected using the APTS at time when the APTS 
shows tvl and tv2. and the reference time signal is reset 
as tvl and tv2 at the respective time. 
[0349] The video decoder 521 continues extension 
and reproduction of the conpression video signal B, 
and the difference between the VPTS#B and the refer- 
ence time signal exceeds 33 msec, as the threshold 
value at T7. Accordingly the video reproduction timing 
control means of the video decoder 521 skips one frame 
which is originally to be reproduced to correct the repro- 
duction timing so that the difference between the 
VPTS#B and the reference time signal is equal to or 
less than the threshold value. 

[0350] Similarly, the video decoder 531 continues 
extension and reproduction of the compression video 
signal C. and the difference between the VPTS#C and 
the reference time signal exceeds 33 msec, as the 
threshold value at T8. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 
reproduces one frame in repetition which has been 
already reproduced to correct the reproduction timing 
so that the difference between tiie VPTS#C and the ref- 



erence time signal is equal to or less than the threshold 
value. 

[0351] As described above, in the fourth example, 
when the difference between the reference time signal 

5 and the values of VPTSs detected by the video decod- 
ers 521 and 531 exceeds the threshold value, the video 
reproduction timing control means of each video 
decoder performs correction so that the difference 
between the reference time signal and the VPTS does 

10 not exceed the threshold value. 

[0352] By correcting the reference time signal using 
the VPTS#A detected by the video decoder 551, the 
video signal reproduced by the video decoder 551 is not 
accompanied by any unnaturalness in the visual output 

15 due to the frame-by-frame skipping or repeated repro- 
duction. Thus, the pictures can be synchronized with 
one another. 

(Example 5) 

20 

[0353] The fifth example relates to a reproduction 
apparatus including a plurality of video decoders for 
extending and reproducing a compression yndeo signal. 
Each of the video decoders includes reference time sig- 

25 nal generation means. The reproduction apparatus cor- 
rects the reference time signal of each video decoder 
using an APTS indicating the time to reproduce an 
audio signal to realize synchronization. 
[0354] In the f iftii example, the optical disk shown in 

30 Rgure 70 is used. 

[0355] Rgure 75 is a block diagram of an optical disk 
reproduction a|:paratus in the fifth exanrple. 
[0356] Elements 501 through 542 are the same as 
those shown in Rgure 68 in the third exanrple. Unlike 

35 the reproduction apparatus shown in Rgure 68, the 
reproduction apparatus in this exanrple does not have 
reference time signal generation means 506 independ- 
ently, but each video decoder has reference time signal 
generation means. 

40 [0357] Reference numeral 561 represents a video 
decoder for extending and reproducing conpression 
video signal A, reference numeral 571 represents a 
video decoder for extending and reproducing compres- 
sion video signal B. and reference numeral 581 repre- 

45 sents a video decoder for extending and reproducing 
compression video signal C. 

[0358] Figure 76 shows a structure of each of tiie 
video decoders 561 through 581 used in the fifth exam- 
ple. 

50 [0359] The video decoder includes VPTS detection 
means 901 for detecting a VPTS indicating the repro- 
duction time of the video signal multiplexed as the com- 
pression video signal, video extension means 902 for 
extending the conpression video stream, and video 

55 reproduction, timing control means 903 for comparing 
the reference time signal and the VPTS and skipping or 
repeating the video reproduction on a frame-by-frame 
basis when the comparison result exceeds the thresh- 
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old value, and reference time signal generation means 

904 for generating the reference time signal. 

[0360] In the fifth example, the reference time signal 

of reference time signal generation means 904 included 

in each of the video decoders 561 through 581 is cor- s 

rected using the ARTS detected by the video decoder 

541, 

[0361 ] Since the reference time signals are corrected 
using ttie same ARTS, the referaice time signals gener- 
ated in the video decoders 561 tiirough 581 show the io 
same value after being corrected. 
[0362] After the correction using the ARTS, as in the 
third example, when the difference between the refer- 
ence time signal and the values of VRTS detected by 
each video decoder exceeds tiie threshold value, the 75 
video reproduction timing control means of each video 
decoder performs correction by skipping or repeating 
the reproduction on a frame-by-frame basis so that dif- 
ference between the reference time signal and the 
VRTS does not exceed the threshold value. 20 
[0363] As described above, in tfie fifth example, the 
reference time signal generated in each video decoder 
is corrected with an ARTS, and tiie video reproduction 
timing control means of each video decoder maintains 
the difference between each reference time signal and 25 
each VRTS to be equal to or less than the tiireshold 
value. Thus, the pictures can be synchronized witii one 
another. 

[0364] As in the tfiird exarrple. the audio signal and 
the video signal can be synchronized without providing 30 
any inconvenience in the audio output. 
[0365] In the fifth example, the reference time signals 
in the video decoders 561 through 581 are con-ected 
using the ARTS detected by the audio decoder 541 . The 
pictures can be reproduced in synchronization in a sim- 35 
ilar manner by using one of the video decoders shown 
in Figure 73 in the fourth exanrple and correcting tfie ref- 
erence time signals of the other video decoders using 
the VRTS detected by the one video decoder. 

40 

(Example 6) 

[0366] The sixth exanrple relates to a reproduction 
apparatus for simultaneously reproducing two compres- 
sion video signals. The two compression video signals 45 
are obtained by dividing a signal into a right-eye video 
signal and a left-eye video signal and compressing the 
divided video signals. 

[0367] The overall structure of tiie apparatus is gener- 
ally similar to that of the optical disk reproduction app>a- so 
ratus shown in Rgure 75 in the fiftfi example, but the 
reproduction apparatus in the sixth example includes 
two video decoders for extending compression video 
signals obtained after the division means 505 since two 
video signals are to be reproduced simultaneously Rg- 55 
ure 77 shows a structure of one of the video decoders 
used in the sixth example, and Rgure 78 shows a struc- 
ture of the other video decoder used in the sixth exam- 



ple. 

[0368] As shown in Rgure 77. the video decoder 
includes VRTS detection means 1001 for detecting a 
VRTS indicating the reproduction time of the video sig- 
nal multiplexed as the compression video signal, video 
extension means 1002 for extending the MREG com- 
pression video stream, reference time signal generation 
means 1004 for generating a reference time signal, and 
video reproduction timing control means 1003 for com- 
paring the reference time signal and the VRTS and skip- 
ping or repeating the video reproduction on a frame-by- 
frame basis when the conriparison result exceeds the 
threshold value and also for outputting a horizontal syn- 
chronization signal and a vertical synchronization signal 
for the picture reproduced. 

[0369] As shown in Rgure 78, the other video decoder 
includes VRTS detection means 1101 for detecting a 
VRTS indicating tfie reproduction time of the video sig- 
nal multiplexed as the compression video sigr^l, video 
extension means 1102 for extending the MREG com- 
presaon video stream, reference time signal generation 
means 1 104 for generating a reference time signal, and 
video reproduction timing control means 1003 for com- 
paring the reference time signal and the VRTS and skip- 
ping or r^eating the video reproduction on a frame-by- 
frame basis when the comparison result exceeds the 
threshold value, for outputting a horizontal synchroniza- 
tion signal and a vertical synchronization signal for the 
picture reproduced, and also reproducing the extended 
video signal in synchronization v«th the horizontal/verti- 
cal synchronization signals. 

[0370] The video decoders are connected to each 
otiier so that the horizontal synchronization signal and 
the vertical synchronization signal output from the video 
decoder in Rgure 77 are sent to tfie video decoder in 
Figure 78. 

[0371 J In the optical disk reproduction apparatus in the 
sixth exanple having the above-descnlDed structure, the 
reference time signal generated by each video decoder 
is corrected with an ARTS, and the video reproduction 
timing control means of each video decoder maintains 
the difference t>etween each reference time signal and 
each VRTS to be equal to or less than the tiireshold 
value. Thus, the right-eye picture and the left-eye pic- 
ture can be synchronized with one another on a frame- 
by-frame basis. By using the horizontal and vertical syn- 
chronization signals output by one of the video decoder 
as the horizontal and the vertical synchronization sig- 
nals of the other video decoder, two pictures can be 
reproduced in synchronization on a pixel-by-pixel basis. 
[0372] In the sixth example, compression video sig- 
nals obtained from a 3D video signal are used and 
divided into the right-eye and left-eye signals. Alterna- 
tively, for exanple, an original vkjeo signal having a first 
resolution is divkled in a vertical and/or horizontal direc- 
tion into at least two video signals including a first video 
signal and a second vkjeo signal fiaving a second reso- 
lution which is lower than the first resolution. The result- 
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ant signals are compressed to be used. Thus, a plurality 
of video signals in synchronization with one another on 
a pixel-by-pixel ba^s can be obtained as from a 3D 
video signal. By synthesizing such resultant signals, the 
clear original video signal having the original resolution 5 
is reproduced. 

(Example 7) 

[0373] The seventh exanple relates to an optical disk 10 
reproduction apparatus for extending one compression 
video signal and two compression audio signals and 
reproducing the signals sinruiltaneously. 
[0374] Rgure 81 shows a data structure of the optical 
disk used in the seventh exanple. 75 
[0375] Two audio signals D and E are conrpressed to 
obtain compression audio streams D and E. A vid^ sig- 
nal is conrpressed to obtain a compression video 
stream. 

[0376] The conpression audio streams D and E and 20 
the conpression video stream are packeted in units of 2 
KB into audio packets and video packets. A packet 
header of each packet includes a stream ID for indicat- 
ing which of the conpression audio streams D and E 
arKj the compression video stream is stored, and the 25 
ARTS and VPTS. 

[0377] Figure 79 is a block diagram of the reproduc- 
tion apparatus in the sixth exanple. 
[0378] The reproduction apparatus has a generally 
similar structure to that in Rgure 68. The audio decoder 30 
541 has the same structure as that shown in Rgure 69, 
and the video decoder 531 has the same structure as 
that shown in Rgure 65. The audio decoder 591 has the 
same structure as that shown in Rgure 80. 
[0379] Reference numeral 590 represents a buffer 35 
memory for temporarily storing the compression audio 
signal like the l)uffer memory 540. Reference numeral 
592 represents a speaker for reproducing the audio sig- 
nal. 

[0380] Figure 80 shows a structure of the audio 40 
decoder 591 . The audio decoder 509 includes ARTS 
detection means 1201 for detecting an ARTS stored in a 
packet header of the audio packet, audio extension 
means 1202 for extending the compression audio 
stream, and audio reproduction timing control means 45 
1203 for conparing the reference time signal and the 
ARTS arKi skipping or repeating the audio reproduction 
on an audio frame-by-audio frame basis when the com- 
parison result exceeds the threshold value. 
[0381 ] A reproduction operation in the seventh exam- so 
pie will be described. 

[0382] The operation until the signal read from the 
optical disk 501 is input to the division means 505 is 
similar to that in the other exanples. 
[0383] The data read from the Ixjffer memory 504 is 55 
divided by the division means 505 into a conpression 
video signal, the compression audio signal D and the 
conpression audio signal E, and output. The division 



means 505 identifies which of the conpression video 
signal, the compression audio signal D arxj the com- 
pression audio signal E is stored in each packet with the 
packet ID in the packet header of the packeted data, 
and determines the destination based on the identifica- 
tion result 

[0384] The divided compression video signal, the 
compression audio signal D and compression audio sig- 
nal are temporarily stored in buffer memories 530. 540 
arxJ 590 respectively. 

[0385] The video decoders reads data from the txiffer 
memory 530, extends the compression video signal and 
outputs the signal as a video signal to a monitor 532. 
The audio decoders 541 and 591 read data from the 
buffer memories 540 and 590. extend the conpression 
audio signals and output the signals as audio signals 
through the speakers 542 and 592. 
[0386] The reference time signal generated by the ref- 
erence time signal generation means 506 is corrected 
by an APTS#D detected by the audio decoder 541 . 
[0387] In the audio decoder 591, an APTS#E is 
detected by the ARTS detection means 1201 and the 
compression audio signal E is extended by the audio 
extension means 1202. The audio reproduction timing 
control means 1203 receives the extended audio signal 
output from the audio extension means 1202. the refer- 
ence time signal, and the ARTS#E from the ARTS 
detection means 1201. conrpares the reference time 
signal and the ARTS#E. When the difference between 
the reference time signal and the ARTS#E exceeds the 
threshold value, the audio reproduction timing control 
means 1203 controls the audio reproduction timing so 
that the difference is equal to or less than the threshold 
value. 

[0388] In the seventh exanple, 32 msec is used as the 
threshold value. The video reproduction timing control 
means 1203 performs the following. 

(reference time signal- ARTS#E)>32 msec.:1 audio 
frame is skipped. 

(reference time signal- ARTS#E)<-32 msec.:1 audio 
frame is repeated. 

[0389] The operation of the video decoder 531 for 
extending the compression video signal ax\d correction 
performed when the difference between the reference 
time signal and the VPTS exceeds the threshold value 
are similar to those in the second exanple. 
[0390] In the seventh exanple. due to the precision 
error of the crystal oscillator used in the reference time 
signal generation means 506, the video decoder 531 . 
and the audio decoders 541 arxj 591 ; the audio decod- 
ers 541 arxi 591 are slower and the video decoder 531 
is faster in terms of extension and reproduction with 
respect to the reference time signal. Unless reproduc- 
tion timing is corrected, the reproduced video signals 
are out of synchronization. 

[0391] Rgure 82 is a timing diagram of video repro- 
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duction in the seventh exanple. Part (a) of Rgure 82 
shows the APTS#D wUh respect to reproduction time t 
Part (b) shoyATS the reference time signal, part (c) shows 
APTS#E, at which the compression audio signal E to be 
extended by the audio decoder 531 is to be reproduced, s 
and part (d) shows the VPTS. at the compression video 
signal to be extended by the video decoder 531 is to be 
reproduced. The reference time signal is corrected 
using the APTS#D when APTS#D shows taS and ta4. 
The reference time signal is reset to taS and ta4 at the w 
respective time. 

[0392] The audio decoder 591 continues extension 
and reproduction of the conpression audio signal 
and the difference between the VPTS#E and the refer- 
ence time signal exceeds 32 msec, as the threshold is 
value at T10. Accordingly, the video reproduction timing 
control means 1203 of the audio decoder 591 skips one 
audio frame which is originally to be reproduced to cor- 
rect the reproduction timing so that the difference 
between the VPTS#E and the reference time signal is 20 
equal to or less than the threshold value. 
[0393] The difference between the VPTS and the ref- 
erence time signal exceeds -33 msec, as the threshold 
value at T1 1 and T12. Accordingly, the video reproduc- 
tion timing control means of the video decoder 531 25 
reproduces one frame in repetition which has been 
already reproduced at the respective time to correct the 
reproduction timing so that the difference between the 
VPTS and the reference time signal is equal to or less 
than the threshold value. 30 
[0394] As described above, in the seventh exanrple. 
when the difference between the reference time signal 
and the VPTS#E detected by the audio decoder 591 
exceeds the threshold value, the video reproduction tim- 
ing control means of the audio decoder performs cor- 35 
rection so that difference between the reference time 
signal and the APTS#E does not exceed the threshold 
value. In this manner, each audio signal and the picture 
can be synchronized with one another, 

40 

(Example 8) 

[0395] In the eighth exanple, the clock for performing 
extension is changed for audio reproduction control. 
[0396] The overall structure and operation of the 45 
reproduction apparatus in the eighth example are gen- 
erally similar to those of the optical disk reproduction 
apparatus in the seventh example, but the operation of 
audio reproduction timing control performed when the 
reference time signal and the APTS#E exceeds the so 
threshold value is different from that of the seventh 
exanple. Witii reference to Rgure 83 and 84. audio 
reproduction timing control used in the eighth example 
will be described. 

[0397] Rgure 83 shows an operation when the differ- ss 
ence between ttie APTS#E and tiie reference timing 
signal exceeds 32 msec. Which is tfie threshold for the 
audio reproduction. Part (a) of Rgure 83 shows the ref- 



erence time signal with respect to reproduction time t. 
Part (b) shows the APTS#E. and part (c) shows the 
dock frequency at which the audio decoder 591 per- 
forms extension and reproduction. Ordinary extension 
and reproduction are performed by dockfO having a fre- 
quency which is 384 times the sampling frequency fs of 
the audio signal. The difference between the APTS#E 
and tiie reference time signal exceeds 32 msec, at time 
Til. and accordingly, audio reproduction control means 
switches tiie clock fO to f1. The frequency of dockfl Is 
higher by 1 0% than tiie frequency of clock fO. Extension 
performed with clock f 1 proceeds faster than extension 
performed with clock fO by 10%. Witfi dock f1. the 
extension is performed for 320 msec, from the point 
where tiie difference between the APTS#E and ttie ref- 
erence time signal exceeds 32 msec. Which is the 
threshold value. Thus, the r^roduction timing is cor- 
rected so tiiat the difference between the APTS#E and 
the reference time signal is equal to or less tiian the 
threshold value. 

[0398] Rgure 84 shows an operation when the differ- 
ence between tiie APTS#E and the reference timing 
signal exceeds -32 msec, which is the tiireshold for tiie 
audio reproduction. Part (a) of Rgure 83 shows tiie ref- 
erence time signal with respect to reproduction time t. 
Part (b) shows tiie APTS#E, and part (c) shows tiie 
dod^ frequency at which tiie audio decoder 591 per- 
forms ext^sion and r^roduction. 
[0399] The difference between the APTS#E and tiie 
reference time signal exceeds -32 msec, at time T12. 
and accordingly, audio r^roduction control means 
switches the clock fO to f2. The frequency of dock f2 is 
lower by 10% than tiie frequency of dock fO. Extension 
performed with clock f2 proceeds more slowfy than 
extension performed with clock fO by 10%. With clock f 2, 
the extension is performed for 320 msec, from the point 
where the difference between the APTS#E and the ref- 
erence time signal exceeds -32 msec, which is the 
threshold value. Thus, the r^roduction timing is cor- 
rected so that the difference between the APTS#E and 
the reference time signal is equal to or less than the 
threshold value. 

[0400] As described above, when the difference 
between the APTS#E arrcl the reference time signal 
exceeds the threshold value for the audio reproduction, 
the clock by which the signal is extended is changed so 
that the extension is performed at a higher speed or 
lower speed than the normal speed. By such an opera- 
tion, the reproduction timing is conti-olled so that the dif- 
ference between the APTS#E and tiie reference time 
signal is equal to or less than the threshold value. Thus, 
the audio signals and the video signal can be repro- 
duced in synchronization with no unnaturalness in the 
audio output. 

[0401] In the eigfith example, the frequency of the 
dock is changed by 10%. Needless to say. a more nat- 
ural audio signal is obtained by reducing the clock less 
or gradually. 
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[0402] In the seventh and eighth examples, the refer- 
ence time signal is corrected using the APTS#D. Alter- 
natively, the video decoder shown in Rgure 73 can be 
used, in which case the VPTS output from the video 
decoder can be used for connection. 
[0403] The present invention has been descrtoed by 
way of specific examples. 

[0404] The comparison between the reference time 
signal and the VPTS or APTS, control of the reproduc- 
tion time, correction of the reproduction timing can be 
performed by a microcomputer which controls the 
entirety of the reproduction apparatus. 
[0405] In the above examples, the present invention is 
applied to optical disk reproduction devices. The 
present invention is also applicable to a reproduction 
apparatus for extending signals supplied through com- 
munication networks and digital satellite broadcasting 
as compression signals. 



chronization on a pixel-by-pixel t>asis is realized even 
when, for example, a plurality of compression video sig- 
nals are exterxied and the extended signals are synthe- 
sized into a 3D picture or a high resolution picture. 

5 [041 1] In a reproduction apparatus in which the refer- 
ence time signal is con-ected using an APTS detected 
by an audio decoder and the video output timing is con- 
trolled so that the VPTS matches the corrected refer- 
ence time signal, an audio signal and a plurality of video 

10 signals are synchronized for reproduction with no 
unnaturalness in the audio output. 
[0412] In a reproduction apparatus in which the audio 
output timing is controlled by changing an extension 
clocK audio and video signals are synchronized for 

15 reproduction with no unnaturalness in the audio output 
with no interruption or pause in the audio signal. 

Claims 



INDUSTRIAL APPLICABILITY 20 

[0406] A basic video signal and an interpolation signal 
are divided into frames each having 1 GOP or more and 
subjected to interleaving alternately to be recorded on 
the optical disk as interleave blocks 54 and 55. From 25 
such an optical disk, a progressive/3D reproduction 
apparatus reproduces both information in the interleave 
trfock for the odd field (right eye) and information in the 
interleave block for the even field (left eye). Thus, a pro- 
gressive/3D picture is obtained. A non-progressive/3D so 
reproduction apparatus reproduces information in the 
interleave block of only odd field (right eye) or even field 
(left eye) by track jump. Thus, a conplete two-dimen- 
sional picture is obtained. Thus, compatibility is real- 
ized. 35 
[0407] Especially, a progressive/3 D picture arrarKfe- 
ment information file and a progressive/3D picture iden- 
tifier are recorded on the optical disk. Accordingly, the 
location of the progressive/3D is easily determined. 
Therefore, two ordinary interlace signals can be made 40 
into a progressive signal. Furthermore, it can be 
avoided that pictures for the right eye and left eye of dif- 
ferent contents are output on the 3D TV. 
[0408] In a 3D reproduction apparatus, a pointer used 
for two-dimensional display is used when an 3D identi- 45 
fier is available to change the access process. Thus. 3D 
pictures can be continuously displayed. Moreover, a 3D 
reproduction apparatus is realized without changing the 
two-dimensional format 

[0409] According to the synchronization method of the so 
present invention, a plurality of video signals or a plural- 
ity of audio signals to be simultaneously reproduced are 
extended in synchronization for reproduction. 
[041 0] In the embodiment where a horizontal synchro- 
nization signal and a vertical synchronization signal 55 
which are output from one video decoder are used as 
the horizontal synchronization signal and the vertical 
synchronization signal of another video decoder, syn- 



1. An optical disk reproduction apparatus for repro- 
ducing data in an optical disK in which the optical 
disk has at least a first video stream corresponding 
to a first signal source and a second video stream 
corresponding to a secorxi signal source recorded 
on the optical disk, the first video stream includes a 
plurality of first interleave units and the second 
video stream includes a plurality of second inter- 
leave units, each of the plurality of first interieave 
units is m^ pieces of GOPs, each of the plurality of 
second interleave units is m2 pieces of GOPs. the 
f irst interleave units and the second interleave units 
are recorded on the optical disk in a prescribed 
order, each of the plurality of first interleave units 
corresponds to first time information related to 
reproduction time, and each of the plurality of sec- 
ond interieave units corresponds to second time 
information related to reproduction time, the optical 
disk reproduction apparatus conprising: 

a r^oduction section for reproducing a signal 
recorded on the optical disk; 
a division section for divkiing the reproduced 
signal into the plurality of first interieave units 
included in the first video stream and the plural- 
ity of second interleave units included in the 
second video stream; 

a decoding section for decoding the first inter- 
leave units and the second interleave units; 
and 

an output section for outputting the decoded 
first interieave unit and the decoded second 
interieave unit substantially simultaneously 
based on tine first time information correspond- 
ing to the first interieave unit and tiie second 
time information corresponding to the second 
interieave unit. 

wherein m^ and m2 are each an integer of one 
or more. 
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An optical disk reproduction apparatus according to 
claim 1 . further comprising a synthesis section for 
synthesizing the decoded first interleave unit and 
the decoded second interleave unit. 

5 

An optical disk reproduction apparatus according to 
claim 2, wherein: 

a high resolution video signal includes a low 
resolution corrponent and a high resolution io 
component, 

the first video stream represents the low reso- 
lution component, 

the second video stream represents the high 
resolution component, and is 
the synthesis section synthesizes the decoded 
interleave unit and the decoded second inter- 
leave unit to generate the high resolution video 
signal. 

20 

An optical disk reproduction apparatus according to 
claim 2, wherein: 

a three-dimensional video signal Includes a 
right-eye signal and a left-eye signal. 25 
the first video stream represents the right-eye 
signal. 

the second video stream represerrts the left- 
eye signal, and 

the synthesis section synthesizes the decoded so 
first interleave unit and the decoded second 
interleave unit, thus generating the three- 
dimensional video signal. 

An optical disk reproduction apparatus according to 35 
claim 2. wherein the synthesis section performs a 
prescribed first calculation to the first interleave unit 
arxi the second interleave unit perbrms a pre- 
scribed second calculation to the first interleave unit 
and the second interieave unit, and synthesizes a 40 
result of the prescribed first calculation and a result 
of the prescribed second calculation, thus generat- 
ing a synthesis signal. 

An optical disk reproduction apparatus according to 45 
claim 5, wherein the prescribed first calculation 
includes a sum calculation of the first interieave unit 
and the second interieave unit, and the prescribed 
second calculation includes a difference calculation 
of the first interieave unit and the second interieave so 
unit. 

An optical disk reproduction apparatus according to 
claim 6, wherein the first calculation further 
includes a calculation of adding a first value to a ss 
result of the sum calculation, and the second calcu- 
lation further includes a calculation of adding a sec- 
ond value to a result of the difference calculation. 



8. An optical disk reproduction apparatus according to 
daim 6, wherein the synthesis section assigns the 
result of the first calculation to picture data of an 
Sih line and assigns the result of the second calcu- 
lation to picture data of an (S+1)th line, and S is an 
integer. 

9. An optical disk r^roduction apparatus according to 
daim 8, for reproducing an optical disk obtained by 
performing a first division calculation and a second 
division calculation on a Pth frame of an input video 
signal using video data of at least a 2Qth line arKi a 
(2Q+1}th line of the input video signal, locating a 
result of the first division calculation in a 2Qth line 
of the first video stream, locating a result of the sec- 
ond division calculation in a 2Q*th tine of the second 
video stream, performing the first division calcula- 
tion and the second division calculation on a 
(P+1)th frame of the irput video signal using video 
data of at least the 2Qth line and tiie (2Q+1)tii line 
of the input video signal, locating a result of the first 
division calculation in a (2Q+1)th line of the first 
video stream, and locating a result of the second 
division calculation in a (2Q+1)th line of the second 
video stream, 

wherein the synthesis section perforrr^ the 
sum calculation and the difference calculation of a 
video signal of a 2Q'th or a 2(Q+1)th line of a 
decoding sigr^ of the first video stream and a 
video signal of the 2Qth or tiie (2Q+1)th line of tiie 
second video stream, thus generating a synthesis 
signal which has a result of the sum calculation as 
a video signal of a 2R1h line and a result of the dif- 
ference calculation as a video signal of a (2R+1)th 
line; arKi R and Q are each an integer, and R has a 
specific relationship with Q. 

10. An optical disk reproduction apparatus according to 
daim 6, wherein the synthesis section generates a 
synthesis signal using color information of the first 
video stream but without using color information of 
the second video stream. 

1 1 . An optical disk reproduction apparatus according to 
daim 6. wherein: 

the high resolution video signal includes a low 
resolution component and a high resolution 
conponent, and 

the synthesis section transforms a parameter 
of the sum calculation and the difference calcu- 
lation based on filter identification irrfbrmation 
which represents a division fitter parameter of 
the high resolution component arxJ the low res- 
olution component. 

1 2. An optical disk reproduction apparatus according to 
daim 5. wherein: 
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a high resolution video signal includes a low 
resolution conponent and a high resolution 
component. 

the first video stream represents the low reso- 
lution component. 5 
the second video stream represents the high 
resolution component, and 
the synthesis section generates a synthesis 
signal using color information of the first video 
stream but without using color information of 10 
the second video stream. 

13. An optical diskr^roduction apparatus according to 
claim 5, wherein: 

IS 

a high resolution video signal includes a low 
resolution component and a high resolution 
component 

the first video stream represents the low reso- 
lution component, 20 
the second video stream represents the high 
resolution conponent, and 
the synthesis section alters a calculation 
parameter in accordance with division informa- 
tion which represents a division parameter 25 
when the high resolution signal is separated 
from the low resolution signal, the division infor- 
mation toeing reproduced from the optical disk. 

14, An optical disk reproduction apparatus according to 30 
claim 13, wherein a filter constant is used as the 
calculation parameter. 

1 5- An optical disk reproduction apparatus according to 
claim 5. wherein tiie synthesis section synthesizes 35 
the result of the prescribed first calculation and the 
result of the prescribed second calculation in a ver- 
tical direction. 

16- An optical disk reproduction apparatus according to 40 
claim 5, wherein the synthesis section synthesizes 
the result of the prescribed first calculation and the 
result of tine prescribed second calculation in a hor- 
izontal direction. 

45 

1 7. An optical disk reproduction apparatus according to 
claim 5. wherein the synthesis section transforms 
the synthesis signal into a progressive signal. 

1 8. An optical disk reproduction apparatus according to so 
claim 2. wherein the decoding section performs 
decoding using a motion conpensation signal of 
the first video stream as a motion compensation 
signal of the second video stream. 

55 

19- An optical disk reproduction apparatus according to 
claim 2. further comprising video identification 
means for identifying identification information 



which indicates that a high resolution video signal 
or a three<limensional video signal are recorded, 
wherein: 

when the video identification means identifies 
the identification information, the optical disk 
reproduction afparatus optionally reproduces 
both the first interleave unit and the second 
interleave unit, and 

the decoding section and tiie synthesis section 
respectively decodes and synthesizes the high 
resolution video signal and/or tine tiiree-dimen- 
sional video signal. 

20- An optical disk reproduction apparatus according to 
daim 19, wherein, when the video identification 
means does not reproduce tiie identification infor- 
mation, the optical disk reproduction apparatus 
optionally reproduces only the first interleave unit 

21. An optical disk reproduction apparatus according to 
daim 20. wherein, when the video identification 
means does not reproduce the identification infor- 
mation, the optical disk reproduction apparatus 
optionally reproduces only the first interleave unit 
and outputs the first interleave unit with the number 
of scanning lines of the first signal source being 
increased. 

22. An optical disk reproduction apparatus according to 
daim 1 . for r^roducing an optical disk having first 
reproduction information indicating that information 
for reproducing the first interieave unit is present 
and information for reproducing the second inter- 
leave unit is absent second reproduction informa- 
tion indicating that information for reproducing the 
first interleave unit and information for r^roducing 
the second interieave unit are both present, identifi- 
cation information indicating that the first reproduc- 
tion information is valid, and high resolution video 
signalAhree-dimensional video signal recording 
identification information indicating that high resolu- 
tion or three-dimensional video signal is divided into 
the first video stream and the second video stream. 

wherein, when the high resolution video sig- 
nalAhree-dimensional vkieo signal recording identi- 
fication information is detected, tiie optical disk 
reproduction apparatus optionally reproduces tx5th 
the first interleave unit and the second interieave 
unit in accordance with the second reproduction 
information. 

23. An optical disk reproduction apparatus according to 
daim 22. wherein the optical disk reproduction 
apparatus reproduces the second r^roduction 
information to acquire starting position information 
of an immediately sut>sequenl interieave unit of a 
specific interieave unit in each video stream, and 
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thus reproduces both the first interleave unit and 
the second interleave unit. 

24. An optical disk reproduction apparatus according to 
claim 22, wherein, when the high resolution video s 
signal/three-dimensional video signal recording 
identification infornnation is not detected, the optical 
disk reproduction apparatus reproduces the first 
interleave unit in accordance with the first reproduc- 
tion information. io 

25. An optical disk reproduction apparatus according to 
daim 1 . wherein tiie optical disk stores n pieces of 
video streams respectively corresponding to n 
pieces of signal sources, and is 

the optical disk reproduction apparatus furtiier 
cornprises a sdection section for selecting i 
pieces of video streams including the first video 
stream and the second video stream from the n 20 
pieces of video streams, and n and i are each 
an integer of two or more. 

26- An optical disk reproduction apparatus according to 
claim 25. wherein the division section includes a 25 
buffer section for buffering the i pieces of video 
streams, and the buffer section has a total capacity 
of 1 102x(i-l) kbyte or more. 

27. An optical disk reproduction apparatus according to 30 
claim 26, wherein i=2. 

28- An optical disk r^roduction apparatus according to 
claim 1 . wherein at least the first video stream and 
the second video stream are decoded simultane- 35 
ously, and a one-sere^ vkieo signal having the first 
video stream located on a first area and the second 
video stream located on a second area is output. 

29, An optical disk reproduction apparatus according to 40 
claim 28, wherein the first area and the second area 
are different from each other in a horizontal direc- 
tion. 

30- An optical disk reproduction apparatus according to 45 
claim 29, wherein the synthesis section includes a 
line memory. 

31 . An optical disk reproduction apparatus according to 
claim 28. wherein information displayed on the first so 
area is enlarged or reduced in accordance with an 
externally input instruction signal. 

32. An optical disk reproduction apparatus according to 
claim 31 . wherein the synthesis section includes a 55 
frame memory. 

33. An optical disk reproduction apparatus according to 



daim 31 , wherein the first area is enlarged and the 
second area is reduced in accordance with an 
externally irput instaiction signal. 

34. An optical disk reproduction apparatus according to 
daim 28, wherein a sii) picture of either one of the 
first video stream and the second video stream is 
displayed. 

35. An optical disk reproduction apparatus according to 
daim 28, wherein a frame memory is ised to con- 
tinuously display the first video stream on the first 
area, n pieces of display areas are provided to dis- 
continuously display an n*th stream in an nth area, 
and n is an integer of one or more. 

36. An optical disk reproduction apparatus according to 
daim 28, wherein only an audio signal of tiie first 
video stream is output 

37. An optical disk reproduction apparatus according to 
daim 28. wherein an audio signal of the first video 
stream and an audio signal of the second video 
stream are output and the aixlio level of the second 
video stream is lowered. 

38. An optical disk reproduction apparatus according to 
daim 1, wherein the output section outputs the first 
video stream as a right-eye signal and the second 
video stream as a left-eye signal. 

39. An optical disk reproduction apparatus according to 
daim 38, wherein the output section outputs the 
first video stream to a right-eye video output section 
and the second video stream to a left-eye video out- 
put section. 

40. An qatical disk reproduction apparatus according to 
daim 39, wherein the output section outputs a syn- 
chronization signal for three-dimensional specta- 
des. the synchronization signal including an 
identification signal of the left-eye signal and the 
righit-eye signal. 

41 . An optical disk reproduction apparatus according to 
daim 39. wherein the output section outputs the 
three-dimensional video only when a three-dimen- 
sional video output instruction is issued. 

42. An optical disk reproduction apparatus according to 
daim 39, wherein, while an area storing a three- 
dimensional video signal is reproduced, the output 
section outputs a display to a display section that 
the three<limensional video signal is being repro- 
duced. 

43. An optical disk reproduction apparatus according to 
daim 38, wherein the output section indudes a mix- 
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ture synthesis section for synchronizing the time 
infornnation of the first video stream and the time 
information of the second video stream, mixes the 
first and second video streams on a field-by-field 
basis or on a frame-by-frame basis, and outputs the 5 
first and second video streams alternately. 



44. An optical disk reproduction apparatus according to 
claim 43, wherein the output section includes a 
three-dimensional switch signal section for output- 10 
ting a signal for switching the left-eye signal and the 
right-eye signal. 

45. An optical disk reproduction apparatus according to 
claim 43. wherein the mixture synthesis section is 
identifies the signal is a three-dimensional video 
signal and mixes the first video stream and the sec- 
ond video stream only when a three-dimensional 
video output instruction is issued. 

20 

46. An optical disk reproduction apparatus according to 
claim 43. wheran, when a non three-dimensional 
video signal is output while an area storing a three- 
dimensional video signal is reproduced, the output 
section provides an output video signal with a dis- 25 
play that the three-dimensional video signal is 
being reproduced. 

47. An optical disk reproduction apparatus according to 
claim 38, wherein, when a non three-dimensional 30 
video signal is output while an area storing a three- 
dimensional video signal is reproduced, the output 
section provides an output video signal with a dis- 
play that the three-dimensional video signal is 
being reproduced. 35 

AS. An optical disk reproduction apparatus according to 
claim 2, for receiving a compressed video stream 
obtained by compressing each of a plurality of 
video signals to be reproduced in synchronisation 40 
and a plurality of compressed video signals 
obtained by multiplexing video reproduction time 
information indicating the time to reproduce the 
video signal and then performing extension and 
reproduction, the optical disk reproduction appara- 45 
tus further comprising: 

reference time signal generation means for 
generating a reference time signal; and 
a plurality of video extension reproduction so 
means for extending the compressed video 
stream and controlling the r^roduction time of 
the video signal which has been extended in 
accordance with the difference between the 
reference time signal and the video reproduc- 
tion time information, 

wherein the reference time signals of the plu- 
rality of video extension reproduction means 



are compensated for at substantially the same 
time using same information. 

49- An optical disk reproduction apparatus according to 
daim 48, further comprising at least one audio sig- 
nal extension reproduction means for receiving a 
corrpressed audio stream obtained by compress- 
ing an audio signal to be reproduced in synchroni- 
sation with the video signals and at least one 
compressed audio signal obtained by nwltiplexing 
audio reproduction time information indicating the 
time to r^roduce the audio signal, then extending 
tiie compressed audio stream, and outputting the 
audio reproduction time information, 

wherein the reference time signal is com- 
pensated for by using the audio reproduction time 
information output by the audio extension reproduc- 
tion means. 

50. An optical disk reproduction apparatus according to 
daim 48, wherein at least one of the plurality of 
video extension reproduction means outputs video 
reproduction time information, and the refererx;e 
time signal Is compensated for by using the video 
reproduction time information output by at least 
ones of the pluralrty of the video extension repro- 
duction means. 

51. An optical disk reproduction apparatus according to 
daim 48, wherein the video extension reproduction 
means skip-reproduce or repeat-reproduce a frame 
of the video signal to control the r^roduction time. 

52. An optical disk reproduction apparatus according to 
daim 48. wherein at least one of the plurality of tiie 
video extension reproduction means outputs a hor- 
izontal synchronization signal and a vertical syn- 
chronization signal of the vkjeo signal, thus to 
synchronize video reproduction performed by 
another video extension reproduction means to the 
fK)rizontal synchronization signal and the vertical 
synchronization signal. 

53. An optical disk reproduction apparatus for repro- 
ducing an optical disK in whic^ the optical disk 
stores at least one audio stream, the audio stream 
indudes a plurality of corrpressed audio signals, 
and each of the plurality of corrpressed audio sig- 
nals corresponds to time information related to 
reproduction time, the optical disk reproduction 
apparatus corrprising: 



a reproduction section for reproducing a signal 
recorded on the optical disk; 
55 a division section for dividing the reproduced 

signal into a plurality of compressed audio sig- 
nals included in the audio stream; 
reference time signal generation means for 
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generating a reference time signal; 

an extension section for extending the plurality 

of audio signals; and 

an output section for controlling timirKj for out- 
putting the extended audio signal teased on the 5 
difference between the time information corre- 
sponding to each of the plurality of conpressed 
audio signals and the reference time signal. 

54. An optical disk reproduction apparatus according to io 
claim 53, wherein at least one of a plurality of output 
sections outputs audio r^roduction, and the refer- 
ence time signal is compensated for by using the 
audio r^roduction time information output by the at 
least one of a plurality of output sections. is 

55. An optical disk reproduction apparatus according to 
daim 53. further comprising at least one video sig- 
nal extension reproduction means for receiving a 
conpressed video stream obtained t>y compress- 20 
ing a video signal to be reproduced in syrx^hroniza- 
tion with the audio signal and at least one 
compressed video signal obtained by multiplexing 
video reproduction time information Indicating the 
time to reproduce the video signal, then extending 25 
the conpressed video stream, and outputting the 
video reproduction time information. 

wherein the reference time signal is com- 
pensated for using the video reproduction time 
information output by the video extension reproduc- 30 
tion means. 

56. An optical disk reproduction apparatus according to 
claim 53, wherein the audio stream is obtained by 
compressing an audio signal every time unit 35 
riefen-ed to as audio frame, and the output section 
skip-reproduces or pauses the audio frame to con- 
trol the reproduction time. 

57. An optical disk reproduction apparatus according to 40 
claim 53, wherein the output section changes a fre- 
quency of a clock for performing extension repro- 
duction to control the reproduction time. 

58. An optical disk having at least a first video stream 45 
corresponding to a first signal source and a second 
video stream corresponding to a second signal 
source recorded on the optical disK wherein the 
first video stream includes a plurality of first inter- 
leave unrts and the second video stream includes a so 
plurality of second interleave units, each of the plu- 
rality of first interleave units is m^ pieces of GOPs, 
each of the plurality of second interleave units is m2 
pieces of GOPs. the first interleave units arxj the 
second interleave units are recorded on the optical ss 
disk in a prescribed order, each of the plurality of 
first interleave units corresponds to first time infor- 
mation related to reproduction time, and each of the 



plurality of second interleave units corresponds to 
second time information related to reproduction 
time. 

59. An optical disk accordirrg to claim 58, wherein: 

a high resolution video signal includes a low 
resolution component and a high resolution 
conponent. 

the first video stream recorded on the optical 
disk represents the low resolution conponent, 
and 

the second video stream recorded on the opti- 
cal disk represents the high resolution compo- 
nent 

60. An optical disk according to claim 59, wherein: 

the low resolution component of the first video 
stream recorded on the optical disk is gener- 
ated by a sum calculation of specific two or 
more signals of the high resolution signal, and 
the high resolution conponent of the second 
video stream recorded on the optical disk is 
generated by a difference calculation of spe- 
cific two or more signals of the high resolution 
signal. 

61. An optical disk according to claim 60. wherein the 
low resolution component of the first video stream 
recorded on the optical disk and the high resolution 
conponent of the second video stream recorded on 
tiie optical disk are generated as a result of division 
performed in a vertical direction by video signal divi- 
sion means. 

62- An optical disk according to claim 61 , wherein: 

the first video stream has, in a 2Q*th line, a 
result of a first division calculation performed 
on a Pth frame off an input video signal using 
video data of at least a 2Q*th line and a 
(2Q+1)th line of the input video signal, 
the second video stream has, in a 2Qth line, a 
result of a second division calculation per- 
formed on a Pth frame of the input video signal 
using video data of at least a 2Q*th line and a 
(2Q+1)th line of the input video signal, 
the first video stream has, in a (2Q+1)th line, a 
result of the first division calculation performed 
on a (P+1)th frame of the input video signal, 
the second video stream has. in a (2Q+1)th 
line, a result of the second division calculation 
performed on a (P+1)th frame of the input 
video signal, and 
P and Q are each an integer. 

63. An optical disk accorxiing to claim 59. wher^n the 
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low resolution component of the first video stream 
recorded on the optical disk and the high resolution 
component of the second video stream recorded on 
the optical disk are generated as a result of division 
performed in a vertical direction by video signal divi- 5 
sion means- 

64. An optical disk according to daim 59. wherein the 
first video stream recorded on the optical disk and 
the second video stream recorded on the optical 10 
disk are generated by dividing a high resolution 
video signal in a horizontal direction by video signal 
division means, so that the first video stream has a 
horizontal low resolution conponent and the sec- 
ond video stream has horizontal high resolution is 
component. 

65. An optical disk according to claim 64. on which 
overlapping field or frame signals are recorded in a 
video signal in an abbreviated encoded state, and 20 
an identifier is recorded indicating the abbreviated 
field or frame signal. 

66. An optical disk according to claim 59. on which 
identification information is recorded indicating a 25 
calculation parameter used for the division calcula- 
tion for dividing a video signal. 

67. An optical disk according to claim 59, wherein 
motion vector information of a video encoding sig- 30 
nal of the first video stream and motion vector infor- 
mation of a video encoding signal of the second 
video stream have an identical value. 

68. An optical disk according to claim 58, on which at 35 
least the first video stream and the second video 
stream are recorded while being encoded by a sub- 
stantially identical signal format. 

69. An optical disk according to daim 68, wherein the 40 
substantially identical signal format is obtained by 
encoding an NTSC, PAL or SECAM signal. 

70. An optical disk according to claim 58, where inter- 
leave units corresponding to each of first through 45 
mth streams are 1st through mth interleave units, 

the optical disk has: 

first reproduction information including informa- 
tion for reproducing the first interleave unit but so 
excluding information for reproducing the sec- 
ond interleave unit; 

second reproduction information including t>oth 
information for reprodudng the first interleave 
unit and information for reprodudng the secorxJ ss 
interleave units; and 

an identifier for making the second reproduc- 
tion information valid. 
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71. An optical disk according to daim 70, wherein 
reproduction information of one interleave unit 
indudes leading position information of another 
interleave unit, wherein the another interleave unit 
t^longs to the same stream as the one interleave 
unit and is tiie next dosest interleave unit to the one 
interleave unit among interleave units having time 
information. 

72. An optical disk according to daim 71, on which 
reproduction information of the first interleave unit 
in a first table is recorded as the first reproduction 
information, reproduction information of the first 
interleave unit and the second interleave unit in a 
second table is recorded as the second reproduc- 
tion information, and an identifier is recorded indi- 
cating that the first table is valid. 

73. An optical disk according to daim 72. on which a 
table for seamless reproduction is recorded as the 
first table, a table for non-seamless reproduction is 
recorded as the second table, and an identifier is 
recorded indicating the seamless reproduction. 

74. An optical disk according to claim 58, wherein an 
encoded video signal for a right-eye signal of a 
three<limensional video signal is used as at least 
the first video stream, and an encoded video signal 
for a left-eye signal of the three-dimensional video 
signal is used as at least the second video stream, 
an identifier being recorded on the optical disk irxji- 
cating a recording area where the three-dimen- 
sional video signal is recorded. 

75. An optical disk according to claim 58. wherein an 
encoded video signal for a low resolution compo- 
nent of a high resolution video signal is used as at 
least the first video stream, and an encoded video 
signal for a high resolution component of the high 
resdution video signal is used as at least the sec- 
ond video stream, an identifier being recorded on 
the optical disk indicating a recording area where 
the high resolution video signal is recorded. 

76. An optical disk recording apparatus for recording a 
prescribed signal on an optical disK wherein the 
prescribed signal indudes at least a first video 
stream corresponding to a first signal source and a 
second video stream corresponding to a second 
signal source, the first video stream indudes a plu- 
rality of first interleave units and the second video 
stream includes a plurality of second interleave 
units, each of the plurality of first interleave units is 
m^ pieces of GOPs. each of the plurality of second 
interleave units is m2 pieces of GOPs. each of the 
plurality of first interleave units corresponds to first 
time information related to reproduction time, and 
each of the plurality of second interleave units cor- 
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responds to second time information related to 
r^roductioh time. 

77. An optical disk recording apparati^ according to 
claim 76. further conprising video signal division 5 
means for dividing a high resolution video signal 
into a low resolution component and a high resolu- 
tion conrponent. wherein: 

the first video stream recorded on the optical io 
disk represents the low resolution component, 
and 

the second video stream recorded on the opti- 
cal disk represents the high resolution compo- 
nent 15 

78. An optical disk recording apparatus according to 
claim 77, wherein the video signal division means 
generates the low resolution component by a sum 
calculation of specific two or more signals of the 20 
high resolution video signal and generates the high 
resolution component by a difference calculation of 
specific two or more signals of the high resolution 
video signal. 

25 

79. An optical disk recording apF>aratus according to 
claim 78. wherein the video signal division means 
divides the video signal into a vertical low resolution 
component and a vertical high resolution compo- 
nent. 30 

80. An optical disk recording apparatus according to 
claim 79, wherein the video signal division means 
locates; 

35 

a result of a first division calculation performed 
on a P'th frame of an input video signal using 
video data of at least a 2Q*th line and a 
(2Q+1)th line of the input video signal in a 2Q'th 
line of the first video stream, 40 
a result of a second division calculation per- 
formed on a Pth frame of the input video signal 
using video data of at least a 2Qth tine and a 
(2Q+1)th line of the input video signal in a 2Qth 
line of the second video stream. 45 
a result of the first division calculation per- 
formed on a (P+1)th frame of the input video 
signal in a (2Q+1)th line of the first video 
stream, and 

a result of the second division calculation per- so 
formed on a {P+1)th frame of the input video 
signal in a (2Q+1)th line of the second video 
stream. 

P and Q being each an integer 

55 

81. An optical disk recording apparatus according to 
claim 77. wherein the video signal division means 
divides the high resolution video signal into a verti- 



cal low resolution cornponent and a vertical high 
resolution component 

82. An optical disk recording apparatus according to 
daim 77, wherein the video signal division means 
divides the high resolution video signal into the first 
video stream having a horizontal low resolution 
component and the second video stream having a 
horizontal high resolution component 

83- An optical disk recording apparatus according to 
daim 82. wherein overlapping field or frame signals 
in a video signal are recorded in an abbreviated 
encoded state, and the optical disk recording appa- 
ratus records an identifier imJicating the abbrevi- 
ated field or frame signal. 

84. An optical disk recording apparatus according to 
daim 77, wherein the apparatus records identifica- 
tion information indicating a calculation parameter 
used for tiie division calculation for dividing a video 
signal. 

85. An optical disk recording apparatus according to 
daim 77, wherein a motion vector detection section 
of a video encoding section uses a motion vector 
detection signal of one of the streams to encode. the 
other stream. 

86. An optical disk recording apparatus according to 
daim 76. wherein at least the first video stream and 
the second video stream are encoded by a sub- 
stantially identical signal format 

87. An optical disk recording apparatus according to 
daim 86, wherein the ^t>stantially identical signal 
format is obtained by encoding an NTSC, PAL or 
SECAM signal. 

88. An optical disk recording apparatus according to 
daim 76, wherein interleave units corresponding to 
each of first through m*th streams are 1st through 
mth interleave units, the optical disk recording 
apparatus records: 

first reproduction information Irx^luding informa- 
tion for reprodudng the first interleave unit txjt 
excluding information for reproducing tine sec- 
ond interleave unit; 

second reproduction information including both 
information for reproducing the first interleave 
unit and information for reproducing the second 
interleave units; and 

an identifier for making the second reproduc- 
tion information valid. 

89. An optical disk recording apparatus according to 
daim 88, wherein reproduction information of one 
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interleave unit includes leading position infornnation 
of another interleave unit wherein the another 
interleave unit belongs to the same stream as the 
one interleave unit and is the next closest interleave 
unit to the one interleave unit among interleave 5 
units having time information. 

90. An optical disk recording apparatus according to 
claim 89» wherein the apparatus records reproduc- 
tion information of the first interleave unit in a first 10 
table as the first reproduction information, repro- 
duction information of the first interleave unit and 
the second interleave unit in a second table as the 
second reproduction information. arKl an identifier 
indicating that the first table is valid. is 

91. An optical disk recording apparatus according to 
claim 90. which records a table for seamless repro- 
duction as the first table, a table for non-seamless 
reproduction as the second table, and an identifier 20 
indicating the seamless reproduction. 

92. An optical disk recording apparatus according to 
claim 76. wherein an encoded video signal for a 
right-eye signal of a three-dimensional video signal 25 
is used as at least the first video stream, and an 
encoded video signal for a left-eye signal of the 
three-dimensional video signal is used as at least 
the second video stream, an identifier being 
recorded on tiie optical disk indicating a recording 30 
area where the tiiree-dimensional video signal is 
recorded. 

93. An optical disk recording apparatus according to 
claim 76. wherein an encoded video signal for a low 35 
resolution component of a high resolution video sig- 
nal is used as at least the first video stream, and an 
encoded video signal for a high resolution conpo- 
nent of tiie high resolution video signal is used as at 
least the second video stream, an identifier being 40 
recorded on the optical disk indicating a recording 
area where the high resolution video signal is 
recorded. 

94. An optical disk according to claim 75. having a 45 
result of a specific calculation of the identification 
information and disk attribute information inherent 

in a master disk of the optical disk or tiie optical 
disk. 
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FIG. 15 
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FIG. 1 6 
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FIG. 1 7 
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FIG. 1 9 
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FIG. 8 2 
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